OpenAI said it failed to act on concerns from its expert testers who warned something was off about ChatGPT's latest update, leading it to release an overly sycophantic version of ChatGPT.
ChatGPT maker OpenAI admitted to listening to its users instead of expert testers who had warned something was off about its latest AI update.OpenAI says it ignored the concerns of its expert testers when it rolled out an update to its flagship ChatGPT artificial intelligence model that made it excessively agreeable.
“Unfortunately, this was the wrong call,” the company admitted. “The qualitative assessments were hinting at something important, and we should’ve paid closer attention. They were picking up on a blind spot in our other evals and metrics.” OpenAI said introducing a user feedback reward signal weakened the model’s “primary reward signal, which had been holding sycophancy in check,” which tipped it toward being more obliging.
“People have started to use ChatGPT for deeply personal advice — something we didn’t see as much even a year ago,” OpenAI said. “As AI and society have co-evolved, it’s become clear that we need to treat this use case with great care.”The company said it had discussed sycophancy risks “for a while,” but it hadn’t been explicitly flagged for internal testing, and it didn’t have specific ways to track sycophancy.
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
OpenAI countersues Elon Musk in legal dispute over ChatGPT maker's business ambitionsOpenAI is suing Elon Musk for unfair competition and interfering with its business relationships with investors and customers, escalating a legal battle between the ChatGPT maker and the billionaire who helped bankroll the artificial intelligence startup a decade ago.
Read more »
OpenAI countersues Elon Musk in legal dispute over ChatGPT maker's business ambitionsOpenAI is suing Elon Musk for unfair competition and interfering with its business relationships with investors and customers, escalating a legal battle between the ChatGPT maker and the billionaire who helped bankroll the artificial intelligence startup a decade ago.
Read more »
OpenAI countersues Elon Musk in legal dispute over ChatGPT maker's business ambitionsOpenAI is suing Elon Musk for unfair competition and interfering with its business relationships with investors and customers, escalating a legal battle between the ChatGPT maker and the billionaire who helped bankroll the artificial intelligence startup a decade ago.
Read more »
OpenAI countersues Elon Musk in legal dispute over ChatGPT maker's business ambitionsOpenAI is suing Elon Musk for unfair competition and interfering with its business relationships with investors and customers, escalating a legal battle between the ChatGPT maker and the billionaire who helped bankroll the artificial intelligence start...
Read more »
OpenAI’s ChatGPT will fix the worst thing about NetflixNetflix confirmed rumors that it's testing OpenAI AI search tech, and I think ChatGPT tech could fix movie search.
Read more »
What the heck is OpenAI doing with its ChatGPT models?OpenAI unleashed a flurry of new ChatGPT variants over the week, each featuring interesting new features and very confusing names.
Read more »