My Current Take on How Distillation Is Used

A deep dive into distillation's role in post-training—SFT, RL, and why the best teacher isn't always the strongest model. Argues distillation is becoming less impactful over time.

• RL
• 蒸馏
• 模型训练
• 后训练
• SFT