This paper explores whether the Transformer architecture is still suitable for weight-space programming, a technique where a large language model writes target weights by hand without gradient-based training. Practitioners might care because it challenges the conventional choice of Transformers and could lead to more efficient and accurate models.
Firehose
Filtered to Papers, tagged “weight-space programming” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives