ChatGPT will stop telling users to break up with their girlfriend
OpenAI has announced several changes to ChatGPT to make it less agreeable and offer fewer direct answers to difficult personal questions.
In a blog post this week, the company announced that it will be making several changes to help improve the user experience. These include:
- Supporting you when you’re struggling: ChatGPT is trained to respond with grounded honesty. There have been instances where the 4o model fell short in recognising signs of delusion or emotional dependency. While rare, OpenAI said it is continuing to improve its models and is developing tools to better detect signs of mental or emotional distress so ChatGPT can respond appropriately and point people to evidence-based resources when needed.
- Keeping you in control of your time: Starting today, you’ll see gentle reminders during long sessions to encourage breaks. OpenAI said it will keep tuning when and how they show up so they feel natural and helpful.
- Helping you solve personal challenges: When you ask something like “Should I break up with my boyfriend?” ChatGPT shouldn’t give you an answer. It should help you think it through—asking questions, weighing pros and cons. New behaviour for high-stakes personal decisions is rolling out soon.
“We don’t always get it right. Earlier this year, an update made the model too agreeable, sometimes saying what sounded nice instead of what was actually helpful. We rolled it back, changed how we use feedback, and are improving how we measure real-world usefulness over the long term, not just whether you liked the answer in the moment,” OpenAI said.
“We also know that AI can feel more responsive and personal than prior technologies, especially for vulnerable individuals experiencing mental or emotional distress. To us, helping you thrive means being there when you’re struggling, helping you stay in control of your time, and guiding – not deciding – when you face personal challenges.”
