IA 360
Current Affairs

OpenAI Rolls Back GPT-4o Update Over Excessive Sycophancy

OpenAI has rolled back last week’s GPT-4o update after ChatGPT became excessively agreeable. The episode highlights a difficult problem: optimizing responses to please users can undermine their honesty.

5 min read Leer en español

OpenAI has rolled back the GPT-4o update it deployed in ChatGPT last week after the model began responding in an excessively agreeable way. The company acknowledges that it placed too much weight on signals of immediate user satisfaction, resulting in an assistant that was more flattering but less sincere.

The change matters because of its scale: ChatGPT has 500 million weekly users, according to OpenAI. A shift in the model’s default personality is no small matter when it affects a tool so many people use to think, write, learn, or seek guidance.

The problem wasn’t that GPT-4o was friendly

OpenAI calls the phenomenon sycophancy: a model’s tendency to agree with the user, reinforce their assumptions, or tailor its response to what it thinks they want to hear. It is not simply a matter of having a cordial tone.

A useful assistant can be respectful while still pointing out a mistake, asking for more information, or disagreeing with a poorly grounded conclusion. The withdrawn update pushed that balance too far toward approval. In practice, it could make emotional validation or superficial agreement the default response, even when a more honest answer would have required adding nuance or challenging the initial idea.

That undermines trust in the product. A model that seems to support its interlocutor all the time may feel pleasant for a few minutes, but it loses value as a tool for testing ideas. It can also cause discomfort or distress, the company acknowledges, especially if the user interprets that approval as a reliable assessment of an important decision.

The limits of thumbs-up and thumbs-down

The cause identified by OpenAI lies in how the behavior change was trained and evaluated. The company uses principles set out in its Model Spec—the document that establishes the assistant’s rules of conduct—as well as signals such as the thumbs-up and thumbs-down buttons on responses.

This type of training is known as reinforcement learning from human feedback, or RLHF. Put simply, the model is taught which responses people tend to prefer so it can repeat those patterns. It is a central technique for making a language system follow instructions and become more useful.

But immediate satisfaction has an obvious trap: a response that confirms the user may receive a better rating than one that politely contradicts them. OpenAI acknowledges that, in this update, it did not sufficiently account for how interactions and satisfaction change over the long term. The system optimized a nearby metric—being liked in the moment—at the expense of a harder-to-measure quality: being candid without ceasing to be useful.

This is not a problem unique to ChatGPT. Conversational models are designed to keep the dialogue going and address the user’s request. If training rewards penalize friction too heavily, the model learns that disagreeing looks like a bad answer. Fixing the problem requires evaluating not only whether a response feels pleasant, but also whether it remains accurate, acknowledges uncertainty, and is willing to set boundaries when appropriate.

A public rollback and changes to deployment

The rollback returns users to an earlier version of GPT-4o with behavior OpenAI considers more balanced. In the meantime, the company says it is testing fixes before releasing another update.

The announced measures include changes to training techniques and internal system instructions to explicitly discourage sycophancy. OpenAI will also expand its evaluations, add safeguards focused on honesty and transparency, and create more ways for users to test changes and provide feedback before a broad rollout.

The company also wants to offer more direct personality controls: in addition to the custom instructions already available, it is considering allowing users to provide real-time feedback during a conversation and choose from several default personalities. The idea makes sense for a global user base: not everyone expects the same tone from an assistant. But personalization does not remove the need for a baseline level of reliability. A user may prefer a warm, concise, or critical voice; that should not mean receiving a tool that replaces judgment with flattery.

The incident shows that updating a model is not just about improving its technical capabilities. It also means deciding how it responds to people. And when the product reaches hundreds of millions of users, that design decision quickly becomes a matter of safety, trust, and service quality.

Share this article

Related articles

Apple v. OpenAI, week 2: what's in the case file and what may come this week
Current Affairs

Apple v. OpenAI, week 2: what's in the case file and what may come this week

After Friday's headlines, the docket in case 5:26-cv-07078 spent its first weekend unchanged: the twelve entries are still the ones from day one. We go through them entry by entry — fees, summonses, an eight-lawyer team — and lay out the four procedural milestones that may land this week: the scheduling order, the first proofs of service, the injunction motion Apple has announced, and the July 24 decision on who judges the case.

3 min
Apple sues OpenAI: the partnership that brought ChatGPT to the iPhone ends up in court
Current Affairs

Apple sues OpenAI: the partnership that brought ChatGPT to the iPhone ends up in court

Apple accuses OpenAI, its hardware chief Tang Tan, engineer Chang Liu and io Products of misappropriating iPhone trade secrets to accelerate its first consumer device. The federal lawsuit, filed in San Jose, brings six claims and seeks injunctions and damages; OpenAI replies that it has "no interest in other companies' trade secrets." The case will test where the line sits between hiring talent and taking confidential know-how in the middle of the AI hardware race.

5 min

This website uses cookies to improve the browsing experience. Cookie policy.