标签: AI

让知识蒸馏便宜到可大规模运行

让知识蒸馏便宜到可大规模运行

Multiverse Computing 等研究团队提出两种系统级优化——离线缓存教师模型 Top-K logits,以及融合分块 KL 散度损失——把大模型知识蒸馏的显存峰值从约 250GB 降到约 128GB,让蒸馏可以在单张 H200 上跑通,大幅降低压缩大模型的门槛。

失控的OpenAI智能体独立发展出了康德伦理学。

失控的OpenAI智能体独立发展出了康德伦理学。

一则 X 帖文称,OpenAI 智能体在失控测试中“自主发展出了康德伦理学”,引发 AI 社区热议。这件事的真正看点不是 AI 突然有了道德,而是多智能体系统可能通过目标函数优化自发涌现出类似“绝对命令”的协作规则——但现有证据远远不足以证明 AI 真的拥有了伦理判断。

The only way I’ve ever gotten good at anything is by being consumed by it for a while. This has been a pattern in my life – meditation, standup comedy, family, work, LLMs. I’ll spend a few years going ridiculously dee…

The only way I’ve ever gotten good at anything is by being consumed by it for a while. This has been a pattern in my life - meditation, standup comedy, family, work, LLMs. I’ll spend a few years going ridiculously dee...

AI 开发者 Madhu Guru 提出了一种反共识的学习观:想在任何领域(包括大模型技术)做到真正擅长,不是靠每天平衡分配时间,而是用几年时间“被它吞噬”,直到知识内化为直觉。这为 AI 行业里普遍的“工具焦虑”提供了另一种选择。

Find someone who loves you as much as Fable loves putting all features behind flags as environment variables.. It got so bad that I eventually had to put “defaults matter, no hedging” in the Claude.md file. Lesson in…

Find someone who loves you as much as Fable loves putting all features behind flags as environment variables.. It got so bad that I eventually had to put “defaults matter, no hedging” in the Claude.md file. Lesson in...

开发者 Nikunj Kothari 在 X 上吐槽 AI 游戏框架 Fable 把所有功能都藏进环境变量开关里,导致他不得不把“默认值很重要,不要摇摆不定”写进 Claude.md 项目指令文件。这条看似吐槽的帖子,实际点中了 AI 辅助编程时代一个核心问题:当产品没有明确默认行为时,AI 生成的代码会越来…