[Bug]: Request Failed Error Code: 500 Message: litellm.APIConnectionError: APIConnectionError: Hosted_vllmException –
![[Bug]: Request Failed Error Code: 500 Message: litellm.APIConnectionError: APIConnectionError: Hosted_vllmException -](https://www.chat-gpts.plus/wp-content/uploads/2026/10/43518-60da76fd-768x403.jpg)
该报错通常出现在 LiteLLM Proxy 以 hosted_vllm 接入 OpenAI 兼容后端、开启流式输出并处于高负载时。流式过程中上游返回 500(或连接异常)后,被异常映射逻辑包装成了误导性的 APIConnectionError: Hosted_vllmException ,优先排查

![[Bug]: model_info.mode is shared across deployments of the same provider model and cannot be cleared (v1.87.0+)](https://www.chat-gpts.plus/wp-content/uploads/2026/10/38543-283c99d6-768x403.jpg)






