Buoyant开源推理控制平面Kinference
Start here
2026年11月5日，vLLM官方博客发布消息，Buoyant正式开源了面向vLLM与Kubernetes的推理控制平面Kinference。据介绍，Kinference主要提供token速率限制、多租户用量与成本追踪、KV缓存感知负载均衡以及声明式推理策略等功能，旨在为基于Kubernetes运行的vLLM推理工作负载提供控制面支持。
AI-generated from reports · Updated 5 hours ago
Report timeline
Follow the reports to see different sides of the story.
- vLLM 官方博客SelectedBuoyant Open-Sources Kinference: An Inference Control Plane for vLLM and Kubernetes
Buoyant has open-sourced Kinference, an inference control plane for vLLM and Kubernetes that provides token rate limiting, multi-tenant usage and cost tracking, KV cache-aware load balancing, and declarative inference policies.
Story heat trend
Current heat 9·Comparable peak 10（Nov 5 09:00）·Comparable change, last 24 hours–
Trends compare only the same parties observed continuously, so the scope can be narrower than current heat counts. Move the pointer or tap the chart to see hourly heat; use the left and right arrow keys on a keyboard.