fkrebs/docs
1
0
Fork 0
Code Issues 14 Pull Requests Actions Packages Projects Releases Wiki Activity

docs: fix voxtral-mini proxy status + remove realtime model entry

Browse Source
This commit is contained in:
Florian Krebs
2026-05-23 00:26:32 +02:00
parent 6aa55fdf2d
commit 9ab9033ab0
1 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
services/llm-benchmark.md
+2 -2
View File
@@ -329,8 +329,8 @@ The following models returned errors or have unresolved issues in live testing:
| Model ID | Status | Error Detail | Action | | Model ID | Status | Error Detail | Action |
|----------|--------|-------------|--------| |----------|--------|-------------|--------|
| `voxtral-mini-latest` | ❌ HTTP 500 | `Cannot connect to host saia-image-proxy:5999` — LiteLLM proxy routing misconfiguration | Fix proxy route; model itself is valid on Mistral API | | `voxtral-mini-latest` | ✅ Fixed 2026-05-23 | Stray `api_base: saia-image-proxy:5999` — deleted + re-added clean; now routes to Mistral API | — |
| `voxtral-mini-realtime-latest` | ❌ HTTP 400 | `Invalid model: voxtral-mini-realtime-latest` — requires WebSocket realtime endpoint, not REST completions | Use Mistral realtime WS API directly; not suitable for standard chat completions | | `voxtral-mini-realtime-latest` | 🗑️ Removed 2026-05-23 | WebSocket-only realtime endpoint; incompatible with REST completions | Removed from LiteLLM; use Mistral WS API directly if needed |
| `mistral-ocr-latest` | ⚠️ Not benchmarked | OCR-mode model; requires document input, not chat completions | Use via dedicated OCR pipeline only | | `mistral-ocr-latest` | ⚠️ Not benchmarked | OCR-mode model; requires document input, not chat completions | Use via dedicated OCR pipeline only |
| `voxtral-mini-transcribe-2507` | ⚠️ Not benchmarked | Audio transcription; not a chat completions model | Use via audio transcription endpoint | | `voxtral-mini-transcribe-2507` | ⚠️ Not benchmarked | Audio transcription; not a chat completions model | Use via audio transcription endpoint |
| `gemini-2.5-flash-image` | ⚠️ Not benchmarked | Image generation; not a chat completions model | Use via images endpoint | | `gemini-2.5-flash-image` | ⚠️ Not benchmarked | Image generation; not a chat completions model | Use via images endpoint |