Papers

Filtered to policy distillation · clear filter

Browse by term

continual learning 86reinforcement learning 48benchmarking 13large language models 12benchmarks 11vision-language models 10language models 9robotics 7world models 7natural language processing 6recursive self-improvement 6generative models 5on-policy distillation 5video generation 5attention mechanisms 4coding agents 4LLMs 4multi-agent systems 4multimodal learning 4multimodal models 4self-distillation 4self-supervised learning 4transformers 4vision-language-action models 4world modeling 4agent-based systems 3agentic models 3agentic search 3agents 3autonomous systems 3

Matching papers

Does On-Policy Distillation Really Distill? From Noisy Teacher to Self-Improvement

89 upvotes · 31 AUG 2026 · Yi Ding, Ruqi Zhang

This paper investigates whether on-policy distillation (OPD) truly improves student policies by analyzing the effects of noisy teacher supervision. It finds that OPD works by suppressing low-probability tokens, which can be achieved without a teacher, and introduces a new method called On-Policy Self-Adaptation (OPSA) that outperforms OPD and traditional reinforcement learning methods.

reinforcement learningon-policy methodsself-supervised learningpolicy distillationcontinual learning

DAPD: Dual-Anchored Policy Distillation

51 upvotes · 3 AUG 2026 · Jianyu Wu, Yizhou Wang, Encheng Su et al.

This paper addresses a problem in self-distillation, where a student model learns to mimic the behavior of a privileged teacher, but performs poorly at inference due to a "privilege illusion". The authors propose a new method, Dual-Anchored Policy Distillation, to resolve this issue and improve performance.

self-distillationon-policy learningpolicy distillationprivilege illusioninformation asymmetryreinforcement learning