TestBench AI Service 1.2.0 — 2026-08-20
Azure OpenAI can now authenticate with a Microsoft Entra ID service principal instead of an API key, and a new VERBOSE log level makes it possible to see the actual request and response payloads when diagnosing a failing agent run — with secrets redacted.
Features
- Entra ID authentication for Azure OpenAI. Set auth_method = "entra_id" in llm_config and provide AZURE_TENANT_ID, AZURE_CLIENT_ID and AZURE_CLIENT_SECRET instead of AZURE_OPENAI_API_KEY. Per-project service principals use the same variable names with a {PROJECT}_ prefix; a project that sets none of the three falls back to the global one. Setting only some of them is rejected at startup with a message naming exactly which variables are missing, rather than failing on the first LLM call.
How to update
pip install --upgrade testbench-ai-service
Restart the service afterwards. No configuration changes are required, but confirm your TestBench server is at least 4.1 and that projects using the Defect Explainer are set to the JSON exchange format — otherwise those agents will now refuse to run.