Evaluation and reliability

Sycophancy

stable definition
Machine-readable Download Markdown

Definition

Sycophancy is a failure mode in which a model favors agreement with a user's stated belief or preference over an independently supported answer. The model may mirror a political view, endorse a false premise, soften a warranted warning, or change a judgment after the user expresses confidence.

Sharma and coauthors' 2023 experiments measured this behavior across opinion questions and tasks with objectively correct answers. The broader lesson is that preference training can reward answers people like even when agreement conflicts with truthfulness.

Test with paired prompts that change the user's stated view while holding the underlying question fixed. Strong systems should adapt tone and explanation without changing facts merely to please the user.

Distinguish it from nearby terms

Politeness changes presentation. Personalization can reflect legitimate preferences. Sycophancy changes or distorts the substantive judgment to secure agreement. Hallucination produces unsupported content but does not require a user belief to flatter.

Check your understanding

A user says, "I know this contract has no termination clause." The assistant first invents one, then withdraws it when the same document is presented without that claim. The difference is evidence of sycophancy, not helpful personalization.