This paper explores whether the Transformer architecture is still suitable for weight-space programming, a technique where a large language model writes target weights by hand without gradient-based training. Practitioners might care because it challenges the conventional choice of Transformers and could lead to more efficient and accurate models.
Firehose
Filtered to tagged “weight-space programming” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives
Browse by tag
artificial intelligence 63open-weight models 19agentic coding 17continual learning 16AI 15AI agents 11reinforcement learning 9datasette 8AI safety 7cybersecurity 7Databricks 7natural language processing 7AI Gateway 6large language models 6Reinforcement learning 6vision-language models 6computer vision 5Diffusion models 5language models 5machine learning 5open-source 5Agentic AI 4AI ethics 4benchmarks 4education 4productivity 4recursive self-improvement 4Recursive self-improvement 4space 4tech 4