Titre original (traduit automatiquement) : vLLM (GitHub Repo)
An open, Kubernetes-native serving stack with cache-aware routing, multi-tenant traffic control, tiered KV cache, and high availability ready for production on Google Cloud
Source originale
cloud.google.com
llm-d.ai · 21 oct.
github.com · 21 oct.