[ACL 2026] Official implementation of MTRouter, a cost-aware multi-turn LLM routing framework accepted to ACL 2026 Main Conference.
-
Updated
Jun 16, 2026 - Python
#
cost-aware-routing
Here are 9 public repositories matching this topic...
ORBIT: A Unified Toolbox for LLM Routing. Unified LLM/model routing, cost-aware inference, multimodal benchmarks, and reproducible evaluation. Accepted by Frontiers of Computer Science (2026).
routing toolbox reasoning efficient-inference budgeted-machine-learning large-language-models llms llm-evaluation mllms llm-router llm-routing cost-aware-routing model-routing llm-routing-benchmark
-
Updated
Oct 16, 2026 - Python
NeurIPS 2025 paper "MESS+: Dynamically Learned Inference-Time LLM Routing in Model Zoos with Service Level Guarantees"
-
Updated
Jan 19, 2026 - Jupyter Notebook
Unified cost-aware router: model x reasoning-depth on one Thompson bandit (factored policy), bi-temporal forget-on-drift statistics memory + auto-drift proxy, GRPO-internalized Qwen3-4B depth policy.
reinforcement-learning thompson-sampling multi-armed-bandit llm-agents llm-routing agent-memory grpo cost-aware-routing build-with-paper
-
Updated
Jul 9, 2026 - Python
Universal, zero-runtime-dependency LLM router for Node, edge, and browser. Routes every prompt to the right model by cost, latency, and measured quality. Native streaming, tool calling, retries, circuit breaking, and budget guards. Drop-in adapters for OpenAI, Anthropic, Gemini, any HTTP endpoint, and the Vercel AI SDK.
react streaming typescript vue nextjs edge gemini openai bun deno cloudflare-workers vercel-edge anthropic vercel-ai-sdk llm-router ai-infrastructure tool-calling langchain-alternative cost-aware-routing model-routing
-
Updated
Jul 27, 2026 - TypeScript
Cost-aware routing of factuality verifiers from cheap pre-call features: reproducibility release
-
Updated
Aug 30, 2026 - Python
Workflow registry and cost-aware routing policy layer for local coding agents.
python mcp vscode multi-agent developer-tools copilot workflow-automation ai-agents local-first llm-tools coding-agents agent-routing agentic-workflows model-context-protocol cost-aware-routing model-routing workflow-registry
-
Updated
Jun 11, 2026 - Python
Learned deliberation routing (System III Configurator) from 'Critique of Agent Model' (arXiv:2606.23991): a cost-aware bandit over reasoning depths (direct/cot/plan+verify), live on Vi-GSM8K, with a GRPO path for Qwen3-4B.
multi-armed-bandit reasoning vietnamese-nlp deliberation llm-agents llm-routing grpo cost-aware-routing build-with-paper
-
Updated
Jul 2, 2026 - Python
RL agents across LangChain & LangGraph, 50+ MCP registry tools, PGVector stores, deployment w Dynamo and inference with vLLM & SGLang
slime environments multi-turn gspo sglang grpo cost-aware-routing docker-sandboxed multi-tur multi-candidate-rollouts verifiable-envs
-
Updated
Oct 24, 2026 - Python
Add this topic to your repo
To associate your repository with the cost-aware-routing topic, visit your repo's landing page and select "manage topics."