#每日新知 2025 - 06 - 29(180/365) D2330
图1 德姆塞茨 图2 日本科研
『人工智能(AI)研究的奇特之处在于,你花费海量的计算资源做实验,结果只是为了学习一些仅用三言两语便能说明的简单道理。毫不夸张地说,这些道理就是诸如“在 A 上训练,如果加上 B,模型就能泛化(generalizes)”、“X 是设计奖励(rewards)的好方法”,或者“方法 M 是样本高效的(sample efficient),这意味着我们应该创造具有这种特定属性的环境”之类的东西。但不知何故,如果你找到了那五个正确的想法,并对它们有了真正深刻的理解,你就会突然遥遥领先于该领域的其他人。/AI research is strange in that you spend a massive amount of compute on experiments to learn simple ideas that can be expressed in just a few sentences. Literally things like “training on A generalizes if you add B”, “X is a good way to design rewards”, or “the fact that method M is sample efficient means that we should create environments with this specific property”. But somehow if you find the correct five ideas and you really understand them deeply, suddenly you’re miles ahead of the rest of the field』——Jason Wei 2025-06-25
9分50秒 166主题 5261字