Research

• Poor credit assignment in diffusion model RL1 paper raises it · 1 addresses it

  Limits efficiency and stability when fine-tuning diffusion models with black-box rewards.

  • DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Modelsraises · addresses
• Vanishing group-relative reward signals1 paper raises it · 1 addresses it

  All rollouts receiving the same reward lose useful trajectory-level information for learning.

  • Self-Retrospection Distillation: Turning Post-hoc Experiences into Prior Foresightraises · addresses
• Memory inefficiency in LLM RL post-training1 paper raises it · 1 addresses it

  High memory demands prevent scaling RL to larger models or longer training runs.

  • LoGRA: Scaling LLM Reinforcement Learning with Low-Rank Gradient Sketchesraises · addresses
• Sparse terminal rewards break value tracking1 paper raises it · 1 addresses it

  Standard critics fail to model value evolution along trajectories, harming credit assignment.

  • TPPO: Tracking-Value PPO For Language Model Reasoningraises · addresses
• Reward hacking in rubric-based RL1 paper raises it · 1 addresses it

  Additive reward aggregation allows policies to exploit criteria compensation, degrading task performance.

  • Scoring Higher, Answering Worse: Mitigating Reward Hacking in Rubric-Based RL via Protocol-Level Rubricsraises · addresses

Named by an AI from these papers' abstracts.

• Sensing communication16+23.1%
• Federated learning40+8.1%
• Agents496−0.8%
• Frontier LLMs430−7.5%
• Learning verifiable rewards165−17.5%
• Forecasting time75−17.6%
• Inference & serving247−18.5%
• Character recognition OCR15−21.1%