Eval Summary
Coverage Status
| Language | Manifest Templates | Eval | Status |
|---|---|---|---|
| Python | 1 (Bicep) | โ | โ Verified |
| TypeScript | 1 (Bicep) | โ | ๐ AZD template exists |
| C# (.NET) | 1 (Bicep) | โ | ๐ AZD template exists |
| Java | โ | โ | โ ๏ธ No AZD template |
| JavaScript | โ | โ | โ ๏ธ No AZD template |
| PowerShell | โ | โ | โ ๏ธ No AZD template |
โ ๏ธ Eval cost note: Each language eval requires ~5 min of agent runtime. Python is verified end-to-end; other languages confirmed in manifest. Java, JavaScript, and PowerShell have no SQL AZD template. Multi-language eval expansion tracked as follow-up.
MCP Tool Validation
| Test | Status | Details |
|---|---|---|
functions_template_get | โ PASS | 2 calls via azure-functions MCP tool |
| Template Discovery | โ PASS | Templates found via resource filter |
| IaC Included | โ PASS | SQL Server Bicep + RBAC in projectFiles |
| E2E Agent Test | โ PASS | 2 azure-functions calls, template sql-trigger-python-azd retrieved and applied |
IaC Validation
| IaC Type | File | Syntax | Policy Compliant | Status |
|---|---|---|---|---|
| Bicep | sql.bicep | โ | โ | PASS |
| Terraform | sql.tf | โ | โ | PASS |
Deployment Validation
| Test | Status | Details |
|---|---|---|
| AZD Template Init | โ PASS | functions-quickstart-python-azd-sql |
| AZD Provision | โ PASS | Resources created in rg-sql-eval |
| AZD Deploy | โ PASS | Function deployed to func-api-arkwcvhvbkqwc |
| HTTP Response | โ PASS | HTTP 200 from function endpoint |
| SQL Server | โ PASS | sql-arkwcvhvbkqwc with Entra-only auth |
| SQL Database | โ PASS | ToDo database created |
Results
| Test | Python |
|---|---|
| Health | โ |
| SQL trigger | โ |
| SQL output | โ |
Notes
- Templates retrieved via
functions_template_get(language: "<language>", template: "<template-name>")MCP tool - Dedicated AZD templates available for Python, TypeScript, .NET
- Requires T-SQL post-deploy for managed identity access
IaC Features
| Feature | Bicep | Terraform |
|---|---|---|
| SQL Server (Entra-only) | โ | โ |
| SQL Database | โ | โ |
| Firewall Rules | โ | โ |
| Private Endpoint (VNet) | โ | โ |
| Azure Policy Compliance | โ | โ |
Post-Deploy Note
SQL managed identity access requires T-SQL after deployment:
CREATE USER [<function-app-name>] FROM EXTERNAL PROVIDER;
ALTER ROLE db_datareader ADD MEMBER [<function-app-name>];
ALTER ROLE db_datawriter ADD MEMBER [<function-app-name>];Test Date
2026-04-22