Skip to content

README.md

Latest commit

 

History

History
19 lines (12 loc) · 835 Bytes

README.md

File metadata and controls

19 lines (12 loc) · 835 Bytes
Raw

ReMax

ReMax is a lightweight policy-gradient method that uses a single greedy-decoded baseline response per prompt to reduce variance without a critic.

Reference: ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models.

Canonical Scripts

Script Infer Train Platform
run_qwen3_8b_fsdp.sh vLLM FSDP NVIDIA
run_qwen2.5_math_7b_fsdp_sync.sh vLLM FSDP+Sync NVIDIA

Override any argument via env vars at the top of the script.

Key Flags

  • algorithm.adv_estimator=remax
  • actor_rollout_ref.actor.use_kl_loss=False and algorithm.use_kl_in_reward=True