vLLM Semantic Router
Co-Founder
System-level intelligent router for mixture-of-models.
Selected Works
Research on frontier technologies for LLM routing and infrastructure.
The current thread is simple: move routing beyond LLM selection and toward system behavior. That means semantic signals, coordinated model paths, and decision loops that optimize quality, cost, and reliability together.
Envoy Gateway
Steering Committee & Maintainer
Manages Envoy Proxy as a standalone or Kubernetes-based application gateway.
Envoy AI Gateway
Maintainer
Manages unified access to generative AI services built on Envoy Gateway.
vLLM AIBrix
Maintainer
Cost-efficient and pluggable infrastructure components for GenAI inference.
Istio
Maintainer
Connects, secures, controls, and observes services.
Kiali
Maintainer
Observability console for Istio with service mesh.
Aeraki Mesh
Maintainer
Manages any layer-7 protocols in a service mesh.
Merbridge
Maintainer
Uses eBPF to speed up service mesh data paths.
Higress
Committer
AI gateway and AI-native API gateway.
Kubernetes Gateway API
Reviewer
Role-oriented, portable, and expressive interfaces for Kubernetes networking.
Kubernetes Ingress2Gateway
Reviewer
Converts Ingress resources to Gateway API resources.