Papers

Filtered to contrastive learning · clear filter

Browse by term

continual learning 33reinforcement learning 21large language models 9vision-language models 8language models 6benchmarking 5autoregressive models 4diffusion transformers 4generative models 4multimodal learning 4robotics 4video generation 4benchmarks 3computer vision 3policy optimization 3self-distillation 3vision-language-action models 3world modeling 3agent-based systems 2autonomous agents 2calibration 2coding agents 2diffusion models 2foundation models 2image synthesis 2in-context learning 2knowledge graphs 2LLMs 2multimodal evaluation 2multimodal large language models 2

Matching papers

Beyond Entropy: Correctness-Aware Advantage Shaping via Contrastive Policy Optimization

10 upvotes · 16 JUL 2026 · Weiwen Xu, Jia Liu, Hou Pong Chan et al.

This paper proposes a new method for advantage shaping in reinforcement learning called Contrastive Policy Optimization (CPO), which uses contrastive disagreement between reference-guided and vanilla generation distributions to indicate correctness. Practitioners might care because it can improve the effectiveness of reinforcement learning methods in generating correct responses.

reinforcement learningpolicy optimizationcontrastive learningcorrectness-aware methodsadvantage shaping