标签: 人工智能

@ChatGPT If you enjoyed this, sign up for free to my newsletter to get my best AI and product guides. Join 110,000+ subscribers here: https://t.co/yz9xcsfrhF

@ChatGPT If you enjoyed this, sign up for free to my newsletter to get my best AI and product guides. Join 110,000+ subscribers here: https://t.co/yz9xcsfrhF

科技博主 Peter Yang 发布了一篇横评测试,对比 ChatGPT、Claude、Grok 和 Gemini 在 10 个真实使用场景中的表现,并透露自己数月前主力工具还是 Claude,现在已明显转向 ChatGPT。这场头部大模型的“换用潮”正在影响个人开发者和创作者的日常工具链选择。

Truly a win-win-win: * NVIDIA is officially the center of open source AI w/ Nemotron and now HF * Hugging Face scores huge + gets the perfect home (no more nagging re business model!) * Open source AI wins! Massive co…

Truly a win-win-win: * NVIDIA is officially the center of open source AI w/ Nemotron and now HF * Hugging Face scores huge + gets the perfect home (no more nagging re business model!) * Open source AI wins! Massive co...

NVIDIA 与 Hugging Face 达成深度合作,将后者纳入其开源 AI 生态版图。此举既让 Hugging Face 摆脱了长期以来的商业模式争议,也让 NVIDIA 通过 Nemotron 模型与 Hugging Face 平台进一步确立开源 AI 基础设施核心地位。

CUDA out of memory

CUDA out of memory

该报错发生在 vLLM 使用 FlashMLA 稀疏 FP8 混合批次解码路径时,稀疏解码内核会分配一个随 --max-num-batched-tokens 线性增长的工作区,且该工作区不受启动时内存预检约束,批次增大后触发运行时 CUDA OOM。优先排查方向是调低 --max-num-batch