RLHF for a helpful, harmless assistant
Preference modeling and RLHF finetune language models into helpful and harmless assistants.
RLHF fine-tuning improved performance on almost all NLP evaluations, showing essentially no alignment tax for helpfulness and harmlessness.
Official source
Training a helpful and harmless assistant with RLHFanthropic.com · published