This paper proposes a new way to use n-gram embeddings in language models, allowing multiple layers to share the same embedding table but adapt it to each layer's needs. Practitioners might care because this approach can significantly reduce the memory required for n-gram tables, enabling larger and more complex models.
Firehose
Filtered to Papers, tagged “shared knowledge” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives