标签： API

If you enjoyed this episode, I highly recommend Shreya and Hamel’s industry-leading AI evals course. It has 4.7 stars with 900 reviews, which is almost unheard of on Maven. The next cohort starts on 9/5 and you can ge…

If you enjoyed this episode, I highly recommend Shreya and Hamel's industry-leading AI evals course. It has 4.7 stars with 900 reviews, which is almost unheard of on Maven. The next cohort starts on 9/5 and you can ge...

AI 评测（AI evals）领域两位知名讲师 Shreya Shankar 与 Hamel Husain 联合推出面向工程师和产品经理的课程，并借助 Peter Yang 的播客推广，目前课程已获得 4.7 星、900 条评价，下一期将于 9 月 5 日开课。

There are two types of AI evals – tops down and bottoms up. From @sh_reya: “Think of top-down as: If you’re in a vacuum, just given the task description, what would you come up with? Claude does a very good job of hel…

There are two types of AI evals - tops down and bottoms up. From @sh_reya: “Think of top-down as: If you’re in a vacuum, just given the task description, what would you come up with? Claude does a very good job of hel...

AI 评估（Evals）正在成为大模型应用开发的核心环节，但 Anthropic 的 Claude 在这类任务中的能力有明显短板。两位资深从业者指出，Claude 擅长自上而下的评估设计，却几乎无法独立完成自下而上的评估，这部分仍需人工主导。