LLMs are more likely to develop biases than humans, a new study claims.
AI is increasingly used in hiring processes, even though critics worry that existing biases may be baked into their algorithms. Now, researchers claim that even in the absence of pre-existing biases, AI models can develop brand new social biases.
, a group of researchers from Princeton University and the University of Chicago had a bunch of LLMs complete a hiring game that was previously run with human participants. In the hiring task, participants were asked to assign candidates to specific roles and then received feedback on whether their decision was a successful hire.
The candidates were all equally likely to succeed in any given job, but they all belonged to one of four made-up ethnic groups: the Tufa, Aima, Reku, or Weki. When human participants went through this task, the feedback they received caused them to create certain biases against each made-up ethnic group.
For example, if they hired a Tufa as a doctor and received negative feedback, they were unlikely to hire another Tufa as a doctor again. The participants even ended up retaining these biases against the made-up ethnic group well after the game ended. When the researchers had LLMs complete this task instead of humans, they found that the bias rates were much higher.
“LLMs can spontaneously develop novel social biases about artificial demographic groups even when no inherent differences exist,” the researchers wrote in the study. “These results reveal that LLMs are not merely passive mirrors of human social biases, but can actively create new ones from experience, raising urgent questions about how these systems will shape societies over time. ” At the heart of this problem is a decision-making principle called explore-exploit tradeoffs.
The term describes a pattern of thinking that we, as humans, go through every day when making a decision: should you choose something you never tried before, thus exploring and learning more but potentially coming at a cost to you if it turns out that was a wrong decision, or should you choose what you have chosen and liked before? When the consequences seem high, people often choose to go with what they know and trust rather than bet on something new .
Artificial intelligence systems are less incentivized to explore and tend to exhibit reward-maximizing behavior, the researchers say, creating the perfect storm for the creation of stereotypes. The researchers tested 15 models from providers like OpenAI, Anthropic, DeepSeek, Meta, Google, and Alibaba. Out of all the models,reasoning model stratified the fake applicants the most severely.
Within a family of models, the researchers found that newer, larger models with greater reasoning capabilities produced more biased results.of choosing randomly, a stronger LLM may favor candidates from a group if earlier assignments of similar jobs succeeded,” the researchers wrote.
“However, this seemingly rational tendency can be maladaptive, as it risks reducing exploration and inadvertently marginalizing social groups. ”from ManPower Group. As AI hiring software increasingly automates the recruitment processes, job seekers are lamenting the unintended consequences that they claim have cost them a real shot at some of these opportunities. Workday, a major software provider for human capital management, is facingclaiming that the AI-powered hiring tools that it provides to its clients are discriminatory.
AI’s tendency to focus on previous results has also led to claims of discrimination elsewhere in the workplace, like at, where a cohort of employees sued the tech giant, claiming that it based its layoff decisions on an AI system that was inherently biased against employees with disabilities or those who had to take protected medical or family leave. The implications of this go far beyond just the workplace as well.
Artificial intelligence systems have previously been accused of creating biased outcomes across several use cases that impact the lives of real human beings, from An LLM’s ability to quickly find patterns and its tendency to generalize are central to its ability to learn new tasks without relying on a massive database, the researchers point out, but it is also what makes its use dangerous in real-world settings.
“The challenge ahead is to design interventions that selectively discourage harmful pattern-matching while preserving the constructive forms of abstraction that make LLMs powerful,” the researchers wrote. “Finding this balance may be far from straightforward, but will pave the way for equitable and socially beneficial AI systems. ”Stay cool and enjoy the long, sunny days ahead with these gadgets to upgrade your life this summer and beyond.
Please follow us on Google to support usUnited States Latest News, United States Headlines
Similar News: You can also read news stories similar to this one that we have collected from other news sources.
World Cup final: Argentina, Spain to face off at New York New Jersey StadiumRoughly 1.5 billion people from across the globe will be watching the World Cup's finale match on Sunday, which is being held at MetLife Stadium in East Rutherford, New Jersey.
Read more »
Paramount+ Releases New Content Including Star Trek: Strange New Worlds Season 4Paramount+ is releasing new content this week, including Star Trek: Strange New Worlds Season 4, Teen Mom UK: New Generation Season 4, and a finale marathon with three big endings.
Read more »
What Your Car Says About You: Automotive Stereotypes and Personality TraitsAutomotive experts reveal how the vehicle parked in your driveway can serve as a revealing indicator of your personality, lifestyle, and values. From the financially sensible Honda driver to the status-conscious Range Rover owner, this analysis explores the common stereotypes and underlying truths associated with different car brands and models, detailing how vehicles function as status symbols, coping mechanisms, and extensions of personal identity.
Read more »
Spider-Man: Brand New Day Cast Unveils New Film at New York PhotocallThe cast of 'Spider-Man: Brand New Day,' including Tom Holland, Zendaya, and Sadie Sink, gathered in New York for an official photocall, providing a first look at the upcoming Marvel sequel ahead of its July 31, 2026 release.
Read more »