标签: LLM

RuntimeError: Expected there to be 1 prompt updates corresponding to 1 video items, but instead found 0 prompt updates! This is likely because you forgot to include input placeholder tokens (e.g

RuntimeError: Expected there to be 1 prompt updates corresponding to 1 video items, but instead found 0 prompt updates! This is likely because you forgot to include input placeholder tokens (e.g

该错误通常出现在 vLLM 服务处理包含大 batch 或多媒体的请求时,多模态缓存(MultiModalReceiverCache)中的条目被同请求内更早出现的新条目挤出缓存,导致后续读取时找不到已标记为“已缓存”的条目;优先排查并调整多模态处理器缓存容量,或将缓存关闭。