diff --git a/services/llm-benchmark.md b/services/llm-benchmark.md index 965d3dc..338a471 100644 --- a/services/llm-benchmark.md +++ b/services/llm-benchmark.md @@ -329,8 +329,8 @@ The following models returned errors or have unresolved issues in live testing: | Model ID | Status | Error Detail | Action | |----------|--------|-------------|--------| -| `voxtral-mini-latest` | ❌ HTTP 500 | `Cannot connect to host saia-image-proxy:5999` — LiteLLM proxy routing misconfiguration | Fix proxy route; model itself is valid on Mistral API | -| `voxtral-mini-realtime-latest` | ❌ HTTP 400 | `Invalid model: voxtral-mini-realtime-latest` — requires WebSocket realtime endpoint, not REST completions | Use Mistral realtime WS API directly; not suitable for standard chat completions | +| `voxtral-mini-latest` | ✅ Fixed 2026-05-23 | Stray `api_base: saia-image-proxy:5999` — deleted + re-added clean; now routes to Mistral API | — | +| `voxtral-mini-realtime-latest` | 🗑️ Removed 2026-05-23 | WebSocket-only realtime endpoint; incompatible with REST completions | Removed from LiteLLM; use Mistral WS API directly if needed | | `mistral-ocr-latest` | ⚠️ Not benchmarked | OCR-mode model; requires document input, not chat completions | Use via dedicated OCR pipeline only | | `voxtral-mini-transcribe-2507` | ⚠️ Not benchmarked | Audio transcription; not a chat completions model | Use via audio transcription endpoint | | `gemini-2.5-flash-image` | ⚠️ Not benchmarked | Image generation; not a chat completions model | Use via images endpoint |