Post-training a model from scratch: SFT, DPO, and RLHF on your laptop

SFT, DPO, RLHF, PPO, GRPO get talked about more than they get run. Here is a tiny working pipeline that does all three on an 82M model on CPU, with real numbers and a reward-hacking gotcha.