[Performance]: Significant performance degradation v1/reranker under concurrent requests while swiching from v.0.19.1 to v0.20.2 v0.21.1
![[Performance]: Significant performance degradation v1/reranker under concurrent requests while swiching from v.0.19.1 to v0.20.2 v0.21.1](https://www.chat-gpts.plus/wp-content/uploads/2026/07/43444-183a064c-768x403.jpg)
用户使用 vLLM 部署 bge-reranker-v2-m3 模型,通过异步 HTTP 客户端向 /v1/score 端点发送并发 Re-Ranker 请求(每次请求包含 100 个文档)。在从 v0.19.1 升级到 v0.20.2 和 v0.21.1 后,观察到平均延迟显著上升(从约 1.3
![[CI Failure]: LM Eval PCP (4xB200)](https://www.chat-gpts.plus/wp-content/uploads/2026/07/49334-644d5265-768x403.jpg)







