Papers

Filtered to KL divergence · clear filter

Browse by term

continual learning 89reinforcement learning 42vision-language models 20benchmarks 13benchmarking 12robotics 12large language models 10language models 9world models 9video generation 7multimodal models 5recursive self-improvement 5video world models 5agentic models 4agents 4diffusion models 4foundation models 4generative models 4human-computer interaction 4multimodal large language models 4natural language processing 4policy optimization 4reasoning 4self-supervised learning 4spatial reasoning 4conversational AI 3dialogue systems 3embodied AI 3evaluation benchmarks 3LLMs 3

Matching papers

On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics

168 upvotes · 28 SEP 2026 · Julianna Piskorz, Antonin Berthon, Mihaela van der Schaar

This paper compares the effectiveness of on-policy and off-policy learning in a distillation setting, finding that rollout policy is not as crucial as previously thought, and that learning rate and token-level KL direction play more significant roles in task performance and forgetting.