Podcasts

Filtered to Evolutionary pre-training · clear filter

Browse by topic

Reinforcement learning 11AI agents 10recursive self-improvement 7AI safety 6Diffusion models 5formal verification 5Agentic AI 4AI ethics 3AI infrastructure 3Code generation 3Human-AI collaboration 3Mechanistic interpretability 3multi-agent systems 3Open Source AI 3Scaling laws 3Synthetic data generation 3Venture capital 3world models 3Agent architecture 2Computational complexity 2Context engineering 2Continual learning 2Continuous learning 2Data generation 2Developer experience 2Drug discovery 2Foundation models 2GPU infrastructure 2Lab automation 2LLM inference 2

Matching episodes

The data black hole at the center of AI

Dwarkesh Podcast · 19 JUN 2026 · 12 min

This episode argues that current AI progress is primarily driven by an immense quantity of high-quality, task-specific data, rather than improvements in sample efficiency. The speaker highlights the vast data requirements of frontier models…

Sample efficiencyData distributionReinforcement LearningSynthetic data generationHuman expert trajectoriesAI training costsScaling lawsWhite-collar automationAI research automationEvolutionary pre-trainingMultimodal data