vLLM Semantic Router Releases d3-ultra: A 27B Open Multimodal Decision Model
vLLM Semantic Router released d3-ultra, a 26.09B Apache-2.0 multimodal decision model scoring 87.2 on its own SR-Text benchmark.
Topic
#model-routing
8 篇笔记
How to Cut Your Agent Bill by 90% With Jev Engineering and Kimi K3
How to find the decisions hiding inside your agents, write questions a system one model answers well, route on calibrated confidence and han...
Running a Software Factory Efficiently at Uber Scale
Post author: @udaykiranIntroductionAI tools are now embedded in every phase of software development at Uber. More than 70% of pull requests ...
Agent 终章（Harness 成本篇）：一次百炼账单降低 88% 实战
关于优化 token，本文或许能够提供一些经验和参考
Why model routing must be in the harness
Inference spend is rising as agents are deployed more widely, take on more complex tasks, and run longer autonomously. Enterprises are start...
Cloudflare OS: an open platform for agents, apps, and work
Cloudflare OS is an open-source platform that lets everyone in your company build apps, automate work, and safely access internal systems, shaped around what your organization knows and how it operates.
多模型路由进入 Agent 会话之后
模型路由在单轮问答中可以按难度分配成本，但进入 Agent 多轮会话后，还要处理上下文、工具状态、缓存和隐式状态。本文拆解会话级路由的智能与工程瓶颈，以及固定强模型、隔离子任务和有状态路由三条现实路线。
Session-Aware Agentic Routing: Continuity-Aware Model Selection for Long-Horizon LLM Agents
How Session-Aware Agentic Routing in vLLM Semantic Router preserves long-horizon agent continuity with session memory, safe model-switch boundaries, prefix-cach