Why it matters
TRL is HF alignment library. Understanding shapes tooling.
Advertisement
The architecture
Trainer classes: SFTTrainer + DPOTrainer + PPOTrainer + more.
Model + tokenizer + data + config.
Advertisement
How it works end to end
Modern alignment: DPO + ORPO + KTO + GRPO in TRL.
Reward modeling.
Trainer patterns.