Filtered to reinforcement learning · clear filter
This paper introduces AREX, a self-improving agent that recursively refines its answers by verifying intermediate results and using the partially verified state to guide subsequent refinement, aiming to improve the efficiency of deep research. Practitioners might care about AREX's approach to reducing the cost of discovery and verification in complex research tasks.
This paper introduces a framework called DeepSearch-Evolve, which helps train self-improving web agents by iteratively refining their performance using their own experience. Practitioners might care because this approach can lead to more efficient and effective agents that can learn from their own mistakes.
This paper proposes a new method for reinforcement learning in large language models, called Group Entropy-Controlled Policy Optimization (GEPO), which helps balance exploration and exploitation by controlling entropy levels across different tasks. Practitioners might care about GEPO because it can lead to more balanced and task-specific exploration levels.
This paper introduces a new framework for building AI agents in Python, allowing developers to write agents that are both deterministic and model-agnostic. Practitioners might care because this framework could simplify the development of reliable AI agents for various applications.
This paper investigates the use of the Muon optimizer in reinforcement learning (RL) post-training and finds that it can significantly improve the success rate of RL agents, especially when combined with other techniques like policy optimization and advantage estimation. Practitioners in RL may care about this research to explore new ways to improve the performance of their agents.
This paper addresses a problem in reinforcement learning (RL) where algorithms with PPO-Clip suffer from "exploration collapse", where they fail to explore new areas of the environment. The authors propose a new method called Riemannian Isometric Policy Optimization (RIPO) that helps to balance exploration and exploitation by using a more accurate geometric metric.
This paper proposes a new method for advantage shaping in reinforcement learning called Contrastive Policy Optimization (CPO), which uses contrastive disagreement between reference-guided and vanilla generation distributions to indicate correctness. Practitioners might care because it can improve the effectiveness of reinforcement learning methods in generating correct responses.
This paper proposes a new way for large language models to learn from feedback, allowing them to retain more detailed information about the quality of their responses and learn from it in a more nuanced way. Practitioners might care because this approach could lead to better performance on tasks where the model doesn't have a clear way to evaluate its own output.
This paper proposes a new method called Distilled Reinforcement Learning that improves large language model post-training by providing fine-grained guidance to transfer new knowledge from a teacher model to a student model. Practitioners might care because it outperforms standard reinforcement learning and on-policy distillation methods in terms of knowledge transfer and model performance.
This paper introduces Robostral Navigate, a vision-language model that enables robots to navigate using only a single monocular RGB camera, making it more scalable and cost-effective for deployment across various robotic platforms. Practitioners might care about this because it can simplify navigation tasks for robots in real-world environments.
This paper proposes a new method to improve reinforcement learning for large language models by using a predictive divergence mask, which helps stabilize off-policy updates. Practitioners caring about improving the stability and performance of LLM-based reinforcement learning might find this approach useful.
This paper proposes a method to improve on-policy distillation by reusing pre-collected teacher data, allowing for faster training without interacting with the environment. Practitioners may care about this technique because it enables scalable and efficient distillation of complex agent models.
This paper develops a new type of artificial intelligence model that can simulate complex environments and make decisions in them, which could be useful for training robots and other agents to perform tasks in the real world. Practitioners might care because these models could help solve problems in areas like robotics, autonomous vehicles, and healthcare.
This paper develops a new optimization framework called Isospectral Optimization (ISO) that improves the performance of language models trained using reinforcement learning with verifiable rewards (RLVR) by reusing the base model's weight spectra while adapting the input and output singular frames. Practitioners might care about this because it could lead to faster and more accurate training of large language models.
This paper introduces H^2SD, a hybrid hindsight self-distillation framework for reinforcement learning with verifiable rewards, which combines the strengths of different methods to improve large language models' reasoning capabilities. Practitioners may care about this work because it addresses limitations of existing methods and shows promising results on challenging reasoning benchmarks.
This paper introduces a new environment called Trace, which allows vision-language models to reason across multiple domains and tasks, using a taxonomy-guided approach. Practitioners might care because this work could lead to more generalizable and transferable AI models.
This paper introduces Agon, a method for training reinforcement learning models to improve their reasoning abilities by competing with each other, rather than just optimizing for the final answer. Practitioners may care about using this approach to improve the quality of reasoning in AI models.
This paper introduces a new method, Surrogate Latent Policy Optimization (SLPO), to improve the performance of autoregressive latent reasoners in reinforcement learning by combining outcome-reward RL with latent reasoning. Practitioners might care because SLPO can help scale the performance of these models at test time, which is currently a major challenge.
This paper introduces a new reinforcement learning framework called SVR-R1 that helps models improve their reasoning abilities by giving them the chance to correct their own mistakes. Practitioners might care about this because it could lead to better performance in tasks that require complex reasoning.
This paper develops a new framework for robotic grasping in complex scenes that uses language to specify task requirements, allowing robots to grasp objects with more precision and flexibility. Practitioners working on robotic grasping and manipulation might care about this approach because it could improve the performance and efficiency of robots in real-world applications.
This paper proposes a new framework for video spatial reasoning that focuses on learning geometric consistency to improve the accuracy and stability of models in tasks like navigation and question answering. Practitioners working on multimodal models and spatial reasoning tasks may benefit from this approach.