分类: AI 工具排错

RuntimeError: Application timeout caused pair closure

RuntimeError: Application timeout caused pair closure

该报错通常出现在 vLLM 多节点(2 节点及以上)大规模张量并行(如 TP=16)启动时的分布式初始化阶段,各 rank 在 Gloo barrier 中互相等待直至超时。优先排查是否由跨节点场景误入对称内存(symmetric memory) rendezvous 逻辑引起,可先尝试使用 --d

[Bug/Perf]: hybrid-SWA prefix caching collapses to zero for ALL requests in multi-session round-robin at ~25% pool occupancy (Gemma-4-31B; e

[Bug/Perf]: hybrid-SWA prefix caching collapses to zero for ALL requests in multi-session round-robin at ~25% pool occupancy (Gemma-4-31B; e

该问题发生在 vLLM 混合注意力(hybrid-SWA)模型的多会话轮询负载中,当 KV 缓存池占用率约达 25% 时,跨请求前缀缓存复用会突然降为零,表现为“全部命中”或“全部未命中”的断崖式切换。优先排查 SWA 组的尾部块是否被提前回收,可借助 CPU offloading(48GiB+)验