$ the-wire · showcase
verl adds a TPU GRPO recipe, drops SGLANG_USE_CPU_ENGINE
By RepoJournal · Filed · About Alignment & Post-training · Composed from the cited sources · methodology
verl shipped a runnable Qwen3-4B GRPO script for TPU clusters and removed an environment variable that rollout code used to set unconditionally.
[hardware] feat: enable TPU GRPO with TorchTitan and vLLM via verl-hardware-plugin verl-project/verl
examples/tpu/grpo/run_qwen3_4b_torchtitan.sh runs Qwen3-4B-Base GRPO on GSM8K with TorchTitan training, vLLM rollout and verl-hardware-plugin; if you already have a Ray TPU cluster with the plugin, the model and the datasets in place, it is a one-line launch. It builds on prior work in PR #50.
[rollout] remove leftover todo ENV, remove SGLANG_USE_CPU_ENGINE environment (#8069) verl-project/verl
verl/workers/rollout/replica.py::_load_sglang() no longer sets SGLANG_USE_CPU_ENGINE=1 before importing SGLang, along with the now-unused os import. If your SGLang rollout depended on that variable arriving from verl rather than your own launch environment, you now have to set it yourself.
[hardware] feat: enable TPU GRPO with TorchTitan and vLLM via verl-hardware-plugin (#8155) verl-project/verl
Same TPU GRPO recipe as the item above; no separate adoption step.