Understanding the Performance Gap in Preference Learning: A Dichotomy of RLHF and DPO

An official website of the United States government Here's how you know

Official websites use .gov

A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS

A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

This content will become publicly available on July 7, 2027

Understanding the Performance Gap in Preference Learning: A Dichotomy of RLHF and DPO

Author(s) / Creator(s):: Shi, Ruizhe; Song, Minhak; Zhou, Runlong; Zhang, Zihan; Fazel, Maryam; Du, Simon S

Publisher / Repository:: Proceedings of Machine Learning Research - International Conference on Machine Learning (ICML), 2026