1# Eval Summary
2 
3## Coverage Status
4 
5| Language | Manifest Templates | Eval | Status |
6|----------|-------------------|------|--------|
7| Python | 1 (Bicep) | [✅](python.md) | ✅ Verified |
8| TypeScript | 1 (Bicep) | [✅](typescript.md) | ✅ Verified |
9| JavaScript | 1 (Bicep) | — | 📋 AZD template exists |
10| C# (.NET) | 1 (Bicep) | — | 📋 AZD template exists |
11| Java | 1 (Bicep) | — | 📋 AZD template exists |
12| PowerShell | 1 (Bicep) | — | 📋 AZD template exists |
13 
14> ⚠️ **Eval cost note:** Each language eval requires ~5 min of agent runtime. Python is verified end-to-end; other languages confirmed in [manifest](https://cdn.functions.azure.com/public/templates-manifest/manifest.json). Multi-language eval expansion tracked as follow-up.
15 
16## MCP Tool Validation
17 
18| Test | Status | Details |
19|------|--------|---------|
20| `functions_template_get` | ✅ PASS | 2 calls via `azure-functions` MCP tool |
21| Template Discovery | ✅ PASS | Templates found via resource filter |
22| IaC Included | ✅ PASS | Service Bus Bicep + RBAC in projectFiles |
23| E2E Agent Test | ✅ PASS | 2 `azure-functions` calls per language, templates retrieved and applied |
24 
25## Results
26 
27| Test | Python | TypeScript |
28|------|--------|------------|
29| Health | ✅ | ✅ |
30| Queue message | ✅ | ✅ |
31| Output binding | ✅ | ✅ |
32| Code Indicator | ✅ `service_bus_queue_trigger` | ✅ `app.serviceBusQueue` |
33| Extra Indicator (IaC) | ✅ `Microsoft.ServiceBus` | ✅ `Microsoft.ServiceBus` |
34| Template Scaffolded | `servicebus-trigger-python-azd` | `servicebus-trigger-typescript-azd` |
35 
36## Notes
37 
38- Templates retrieved via `functions_template_get(language: "<language>", template: "<template-name>")` MCP tool
39- See README for UAMI troubleshooting (500 error, Unauthorized)
40 
41## Test Date
42 
432026-04-22
44