Predictive Divergence Masks for LLM RL
This paper proposes a new method to improve reinforcement learning for large language models by using a predictive divergence mask, which helps stabilize off-policy updates. Practitioners caring about improving the stability and performance of LLM-based reinforcement learning might find this approach useful.