Papers

Filtered to input-based learning · clear filter

Browse by term

continual learning 33reinforcement learning 21large language models 9vision-language models 8language models 6benchmarking 5autoregressive models 4diffusion transformers 4generative models 4multimodal learning 4robotics 4video generation 4benchmarks 3computer vision 3policy optimization 3self-distillation 3vision-language-action models 3world modeling 3agent-based systems 2autonomous agents 2calibration 2coding agents 2diffusion models 2foundation models 2image synthesis 2in-context learning 2knowledge graphs 2LLMs 2multimodal evaluation 2multimodal large language models 2

Matching papers

Visual Contrastive Self-Distillation

39 upvotes · 23 JUL 2026 · Yijun Liang, Yunjie Tian, Yijiang Li et al.

This paper introduces Visual Contrastive Self-Distillation, a method that removes the need for external teacher information and privileged answers in on-policy self-distillation, allowing for simpler and more efficient learning. Practitioners might care about this approach because it can lead to better performance in language models.

self-distillationon-policy learningvisual conditioninginput-based learningimage-text models