The Semantic Routing Moment
The next era of AI will not run on one model. It will run on a Mixture-of-Models—and semantic routing is the decision layer that makes it work.
A preference-aligned Mixture-of-Models presents one stable contract across changing models, hardware, and locations. The user chooses the preference—speed, cost, balance, or accuracy—and the system decides how to realize it.
vLLM Semantic Router is the open decision layer we are building for that future.
vLLM Semantic Router
Co-Founder
An open semantic decision layer for preference-aligned Mixture-of-Models.
Elephant Agent
Creator
Personal-model-first self-evolving AI agent that grows correctable understanding and gets curious at the user's pace.
Inferoa
Builder
Inference-native tokenmaxxing agent harness for loop engineering.
Envoy Gateway
Steering Committee and Maintainer
Manages Envoy Proxy as a standalone or Kubernetes-based application gateway.
Envoy AI Gateway
Maintainer
Manages unified access to generative AI services built on Envoy Gateway.
Fast and Faithful: Real-Time Verification for Long-Document Retrieval-Augmented Generation Systems
SIGIR 2026 Industry Track
Token-Budget-Aware Pool Routing for Cost-Efficient LLM Inference
arXiv Technical Report
vLLM Semantic Router: Signal Driven Decision Routing for Mixture-of-Modality Models
arXiv Technical Report
When to Reason: Semantic Router for vLLM
NeurIPS - MLForSys
Agentic Intelligence Lab
Chair
Chairing the lab's research and community work on agentic AI, personal AI agents, and system intelligence.
Kubernetes AI Gateway WorkGroup
Co-Chair
Leading the community effort to define standards for AI Gateway in the Kubernetes ecosystem.
CNCF Ambassador
Fall 2023 Ambassador
Representing and promoting Cloud Native Computing Foundation projects and values globally.
Linux Foundation APAC Open Source Evangelist
2024 Program
Advocating for open source adoption and best practices across the Asia-Pacific region.
KubeCon Program Committee
KubeCon 2024 Hong Kong
Reviewing and selecting talks for one of the largest cloud-native conferences.