Papers

Filtered to knowledge distillation · clear filter

Browse by term

continual learning 86reinforcement learning 48benchmarking 13large language models 12benchmarks 11vision-language models 10language models 9robotics 7world models 7natural language processing 6recursive self-improvement 6generative models 5on-policy distillation 5video generation 5attention mechanisms 4coding agents 4LLMs 4multi-agent systems 4multimodal learning 4multimodal models 4self-distillation 4self-supervised learning 4transformers 4vision-language-action models 4world modeling 4agent-based systems 3agentic models 3agentic search 3agents 3autonomous systems 3

Matching papers

From Proprietary to Open-Source: Bridging the Distribution Gap via Multi-Agent Protocol Distillation in Agentic Search

64 upvotes · 27 JUL 2026 · Junlin Liu, Jiangwang Chen, Zixin Song et al.

This paper proposes a new method to improve the performance of large language models on knowledge-intensive tasks by distilling knowledge from proprietary models and using reinforcement learning. Practitioners may care about this approach because it can help bridge the gap between proprietary and open-source models, leading to more effective and robust AI systems.

agentic searchknowledge distillationmulti-agent systemsreinforcement learningopen-source models