The warning is valid, but it's not clear anyone is hearing it.
In a week of pretty public exits from artificial intelligence companies, Zoë Hitzig’s case is, arguably, the most attention-grabbing. The former researcher at OpenAI divorced the company in an, but of something real and imminent: OpenAI’s introduction of advertisements to ChatGPT and what information it will use to target those sponsored messages.
There’s an important distinction that Hitzig makes early in her op-ed: it’s not advertising itself that is the issue, but rather the potential use of a vast amount of sensitive data that users have shared with ChatGPT without giving a second thought as to how it could be used to target them or who could potentially get their hands on it. “For several years, ChatGPT users have generated an archive of human candor that has no precedent, in part because people believed they were talking to something that had no ulterior agenda,” she wrote. “People tell chatbots about their medical fears, their relationship problems, their beliefs about God and the afterlife. Advertising built on that archive creates a potential for manipulating users in ways we don’t have the tools to understand, let alone prevent.”published earlier this year announcing that the company will be experimenting with advertising, the company promised that it will keep a firewall between conversations that users have with ChatGPT and the ads they get served by the chatbot. “We keep your conversations with ChatGPT private from advertisers, and we never sell your data to advertisers.” Hitzig believes that is true… for now. But she’s lost trust in the company to maintain that position over the long term, especially because there is nothing actually holding it to follow through on the promised privacy. The researcher argued that OpenAI is “building an economic engine that creates strong incentives to override its own rules,” and warned the company may already be backing away from previous principles.that it doesn’t optimize ChatGPT to maximize engagement—a metric that would especially be of interest for a company trying to keep people locked into conversations so it can serve them more ads. But a statement isn’t binding, and it’s not clear the company has actually lived up to that. Last year, the company ran into an issue of sycophancy with its model—it started becoming overly flattering to its users and, at times, fed into delusional thinking that may have contributed to “that sycophancy isn’t just some mistake in model tuning but an intentional way to get users hooked on talking to the chatbot.when it turns out that data is quite valuable. Hitzig is trying to get out in front of the train before it picks up too much steam, and recommended OpenAI adopt a model that will actually guarantee protections for users—either creating some sort of real, binding independent oversight or putting data in control of a trust with a “legal duty to act in users’ interests.” Either option sounds great, though Meta did the former by creating the Meta Oversight Board and then Hitzig also, unfortunately, may have an uphill battle in getting people to care. Two decades of social media have created a sense ofsurveyed would continue to use the free tier of ChatGPT despite the introduction of advertisements. Anthropic tried to score some points with the public by hammering OpenAI over its decision to insert ads into ChatGPT with a high-profile Super Bowl spot this weekend, but the public response was more confusion than anything,Hitzig’s warning is well-founded. The concern she has is real. But getting the public to care about their own privacy after years of being beaten into submission by algorithms is a real lift.4:00 pmOpenAI Safety VP Reportedly Fired for Sexual Discrimination Against Her Male ColleagueOlympic Figure Skaters Get Heat for Using AI-Generated Music "So you want the world to respect your art but don't give a shit about the art of music that helps you do it?"
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
OpenAI Responds to Critical Super Bowl Commercials by Putting Ads in ChatGPTAfter ads, OpenAI adds ads.
Read more »
OpenAI Wins Key Discovery Battle as It Gains Ground Against Authors in AI LawsuitsThe company cited attorney-client privilege in rejecting a bid for information related to its deletion of two datasets used to train old versions of its AI system.
Read more »
OpenAI Abandons ‘io’ Branding for Its AI HardwareA court filing in a trademark lawsuit reveals OpenAI won't use the name “io” for its AI hardware device, which isn't expected to ship until 2027.
Read more »
What analysts, investors think about OpenAI's path to profitabilityBusiness Insider tells the global tech, finance, stock market, media, economy, lifestyle, real estate, AI and innovative stories you want to know.
Read more »
OpenAI starts testing ads in ChatGPTFind the latest technology news and expert tech product reviews. Learn about the latest gadgets and consumer tech products for entertainment, gaming, lifestyle and more.
Read more »
Anthropic Researcher Quits in Cryptic Public LetterAt Futurism, my work has often centered on bringing a sense of clarity and insight to complex topics ranging from the regulation of emerging technologies to the esoteric ideologies of Silicon Valley executives, while striving not to lose the poetic sense of awe inspired by often-obscure fields like astrophysics and quantum computing.
Read more »