// Dev
Buoyant open-sources Kinference, a traffic controller for vLLM inference on Kubernetes
The Apache 2.0 control plane adds routing policies, KV-cache-aware load balancing and per-tenant metrics. Buoyant says it cut median time-to-first-token by 95% in its own test.