Firehose

Filtered to tagged “layer-wise adaptation” · clear filters

All PeopleCompaniesPapersPodcastsHacker News

Browse by tag

17 NOV 2026 · Paper

This paper proposes a new way to use n-gram embeddings in language models, allowing multiple layers to share the same embedding table but adapt it to each layer's needs. Practitioners might care because this approach can significantly reduce the memory required for n-gram tables, enabling larger and more complex models.