News

How would you like to use vllm The official v0.9.0 Docker image includes PyTorch version 2.7.0. This PyTorch version does not offer support for sm70 (Volta architecture). As the vLLM documentation ...