fkrebs/docs
1
0
Fork 0
Code Issues 14 Pull Requests Actions Packages Projects Releases Wiki Activity

Simplify MCP gateway after Bifrost migration #8

New Issue
Open
opened 2026-05-26 04:21:01 +00:00 by fkrebs · 1 comment
fkrebs commented 2026-05-26 04:21:01 +00:00
Owner
Copy Link
Copy Source

With Bifrost routing MCP natively + OWUI speaking MCP directly, custom mcp-gateway on CT 104 loses its routing role.

Keep only if it does:

  • (a) STDIO lifecycle for spawn MCP servers (Bifrost needs running servers — check whether it lifecycle-manages STDIO)
  • (b) Central secret injection beyond Bifrost VKs
  • (c) Path for non-LLM MCP clients bypassing Bifrost

Action:

  1. Test whether Bifrost can spawn catalog/spawn MCP servers in DinD style
  2. If yes: retire mcp-gateway entirely
  3. If no: keep as STDIO supervisor, put Bifrost in front for governance

Depends-on: LiteLLM→Bifrost issue.

With Bifrost routing MCP natively + OWUI speaking MCP directly, custom `mcp-gateway` on CT 104 loses its routing role. **Keep only if** it does: - (a) STDIO lifecycle for spawn MCP servers (Bifrost needs running servers — check whether it lifecycle-manages STDIO) - (b) Central secret injection beyond Bifrost VKs - (c) Path for non-LLM MCP clients bypassing Bifrost **Action:** 1. Test whether Bifrost can spawn catalog/spawn MCP servers in DinD style 2. If yes: retire `mcp-gateway` entirely 3. If no: keep as STDIO supervisor, put Bifrost in front for governance Depends-on: LiteLLM→Bifrost issue.
fkrebs commented 2026-05-26 06:06:45 +00:00
Author
Owner
Copy Link
Copy Source

Partially done 2026-05-26: _litellm_sync_loop and _lobechat_sync_loop disabled in mcp-gateway/server.py. LiteLLM decommissioned. Full MCP gateway sunset (Phase 3) deferred.

Partially done 2026-05-26: _litellm_sync_loop and _lobechat_sync_loop disabled in mcp-gateway/server.py. LiteLLM decommissioned. Full MCP gateway sunset (Phase 3) deferred.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
fkrebs (Florian Krebs)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: fkrebs/docs#8
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?