AI Operations API
AI operations endpoints are superadmin-only and are served under /api/v1.0.
Observability
| Method | Endpoint | Description |
|---|---|---|
| GET | /admin/ai-ops/overview | Unified AI health, usage, failures, guardrail, and remediation overview |
| GET | /admin/ai-workflow-runs | List AI workflow run traces |
| GET | /admin/ai-workflow-runs/{run_id} | Get one AI workflow run trace |
| GET | /admin/ai-logs | List AI logs |
| GET | /admin/ai-logs/usage | Token usage summary |
| GET | /admin/ai-logs/usage/guardrail-impact | Guardrail impact summary |
| POST | /admin/ai-logs/{log_id}/replay | Replay a logged prompt through the governed prompt replay path |
| POST | /admin/ai-logs/{log_id}/save-prompt | Save a prompt candidate from a log entry |
Provider and Prompt Administration
| Method | Endpoint | Description |
|---|---|---|
| GET | /admin/ai-config/ | Get effective LLM provider configuration |
| POST | /admin/ai-config/ | Create LLM provider configuration |
| PATCH | /admin/ai-config/ | Update LLM provider configuration |
| DELETE | /admin/ai-config/ | Delete LLM provider configuration |
| POST | /admin/ai-config/test-connection | Test the configured LLM provider |
| GET | /admin/ai-model-routing/profiles | List model profiles |
| POST | /admin/ai-model-routing/profiles | Create model profile |
| GET | /admin/ai-model-routing/routes | List model routes |
| PUT | /admin/ai-model-routing/routes | Upsert model route |
| GET | /admin/prompts | List prompt definitions |
| GET | /admin/prompts/{prompt_key} | Get prompt definition details |
| POST | /admin/prompts/{prompt_key}/versions | Create and activate a prompt version |
| POST | /admin/prompts/{prompt_key}/preview | Render a prompt with supplied variables |
| POST | /admin/prompts/{prompt_key}/reset | Reset a prompt route to code defaults |
Embeddings and Budgets
| Method | Endpoint | Description |
|---|---|---|
| GET | /admin/embedding-config/ | Get effective embedding configuration |
| POST | /admin/embedding-config/ | Create embedding configuration |
| PATCH | /admin/embedding-config/ | Update embedding configuration |
| DELETE | /admin/embedding-config/ | Delete embedding configuration |
| POST | /admin/embedding-config/test-embedding | Test the effective embedding provider |
| POST | /admin/embedding-config/reindex-products | Queue product reindexing with current embeddings |
| GET | /admin/ai-budgets | List AI budget overrides |
| DELETE | /admin/ai-budgets/{entry_point_id} | Remove an AI budget override |
Evaluation Runs
| Method | Endpoint | Description |
|---|---|---|
| GET | /admin/ai-evals | List deterministic AI evaluation runs |
| GET | /admin/ai-evals/latest | Get latest eval summary |
| POST | /admin/ai-evals/run | Start an evaluation run |
| GET | /admin/ai-evals/{run_id} | Get evaluation run detail |