KL control in RL: cheat sheet RL-for-LLM training loops: 2024/2025 map Deep RL Mathematical Formulas - Quick Reference Deep RL Quick Reference & Cheat Sheet RL loss functions: cheat sheet RLHF vs DPO vs GRPO vs RLVR: cheat sheet