RuntimeError: Worker failed with error ‘Unknown TurboQuant cache dtype: ‘auto’. Valid presets: turboquant_k8v4, turboquant_4bit_nc, turboquant_k3v4_nc, turboquant_3bit_nc’, please check the stac

在 A100 (SM80) 显卡上使用 vLLM 的 API 服务( vllm serve 或 vllm.entrypoints.openai.api_server )时,设置了 --kv-cache-dtype turboquant_k8v4 并加载 BF16 模型(如 Qwen/Qwen2.5-








