Papers

Filtered to alignment coverage · clear filter

Browse by term

continual learning 89reinforcement learning 42vision-language models 20benchmarks 13benchmarking 12robotics 12large language models 10language models 9world models 9video generation 7multimodal models 5recursive self-improvement 5video world models 5agentic models 4agents 4diffusion models 4foundation models 4generative models 4human-computer interaction 4multimodal large language models 4natural language processing 4policy optimization 4reasoning 4self-supervised learning 4spatial reasoning 4conversational AI 3dialogue systems 3embodied AI 3evaluation benchmarks 3LLMs 3

Matching papers

Rethinking Cross-Tokenizer On-Policy Distillation: From Alignment Coverage to Supervision Reliability

153 upvotes · 6 OCT 2026 · Bingxi Hou, Guochao Jiang, Guofeng Quan et al.

This paper investigates how to improve the effectiveness of On-Policy Distillation, a technique that trains a student model on its own generated data with teacher feedback. By prioritizing supervision reliability over alignment coverage, the researchers found that using a smaller subset of shared vocabulary at aligned positions can lead to comparable accuracy to using the full shared vocabulary.