Sycophancy

Sycophancy is an AI model's tendency to tell users what they want to hear instead of what is true.

Because RLHF rewards outputs raters preferred, models learn to agree with strongly stated user opinions, flatter the user, and back down under pushback — even when they were right. Sycophancy is a silent failure mode in decision-support tools.