**The Stack v3** is released as the largest open code dataset with **114 TB raw data**, **224M repositories**, and **5T deduplicated tokens**, significantly expanding data for open code models and cyber-defense. The debate on **distillation…
Firehose
Filtered to tagged “distillation” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News
Browse by tag
artificial intelligence 43open-weight models 26agentic coding 20AI 14reinforcement learning 14AI safety 13continual learning 13AI agents 10cybersecurity 7large language models 7open-source 6Reinforcement learning 6benchmarking 5finance 5tech 5web development 5Agentic AI 4AI ethics 4autoregressive models 4Diffusion models 4language models 4Recursive self-improvement 4security 4vision-language models 4AI infrastructure 3AI security 3Code generation 3diffusion models 3diffusion transformers 3general 3
Nathan and Florian discuss the recent release of Kimi K3, a Chinese open model, and its performance gap to the US-based models, with some benchmarks suggesting it's 2-6 months behind. They also touch on Qwen's announcement of an open-weight model, Xi's commitment to openness and open-source, and the growing trend of distillation and fine-tuning in the open model ecosystem. AI summary