Routing Notes.
4 entries on systems, routing, and open source. Long-form posts, published slowly.
The Semantic Routing Moment
The next era of AI will not run on one model. It will run on a Mixture-of-Models—and semantic routing is the decision layer that makes it work.
The Philosophy of vLLM SR
vLLM Semantic Router is not a smarter model picker. It is a control plane for turning semantic work into explainable capability paths across models, tools, memory, policy, gateways, and hardware.
Semantic Routing as Energy Infrastructure
Not every token deserves a frontier model. Every semantic workload deserves the right intelligence budget.
The Second Half of LLM Routing
tldr: We’re reaching LLM routing’s halftime.