Eric Jang explains how to build AlphaGo from scratch using modern AI tools, detailing the game of Go's rules and the core Monte Carlo Tree Search (MCTS) algorithm. He describes how deep neural networks, specifically value and policy network…
Firehose
Filtered to tagged “LLM training” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 63open-weight models 19agentic coding 17continual learning 16AI 15AI agents 11reinforcement learning 9datasette 8AI safety 7cybersecurity 7Databricks 7natural language processing 7AI Gateway 6large language models 6Reinforcement learning 6vision-language models 6computer vision 5Diffusion models 5language models 5machine learning 5open-source 5Agentic AI 4AI ethics 4benchmarks 4education 4productivity 4recursive self-improvement 4Recursive self-improvement 4space 4tech 4
Reiner Pope delivers a blackboard lecture on the mathematical and hardware principles behind training and serving large language models. He explains how batch size, sparsity, and various parallelism strategies (expert, pipeline) impact late…
LLM trainingLLM inferenceBatch sizeLatency optimizationCost analysisRoofline analysisMemory bandwidthCompute performanceKV CacheSparsityMixture of ExpertsExpert parallelismData center architectureScale up networkScale out networkPipeline parallelismMicrobatchingMemory capacityChinchilla scalingRL generationAPI pricingContext lengthCryptographic ciphersNeural network architectureReversible networks