Removing Demographic Data Can Make AI Discrimination Worse

United States News News

Removing Demographic Data Can Make AI Discrimination Worse
United States Latest News,United States Headlines
  • 📰 HarvardBiz
  • ⏱ Reading Time:
  • 44 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 21%
  • Publisher: 63%

Work-arounds that may answer the problem in some countries.

which aimed to use a ML algorithm. A team of data scientists, trained a ML algorithm on resume data to predict job performance of applicants in hopes of streamlining the process of selecting individuals to interview. The algorithm was trained on the resumes of current employees , with gender and names removed, in hopes of preventing discrimination, per human decision-making practices.

Including gender significantly decreases discrimination — by a factor of 2.8 times. Without access to gender, the ML algorithm over-predicts women to default compared to their true default rate, while the rate for men is accurate. Adding gender to the ML algorithm corrects for this and the gap in prediction accuracy for men and women who default diminishes. Additionally, the use of of gender in the ML algorithm also increases profitability on average by 8%.

We find that proxies can predict gender with 91% accuracy in our data, so although gender is removed, much gender information is estimated by the algorithm through proxies. But these proxies favor men. Without access to the real gender data the ML algorithm is not able to recover as much information for women compared to men, and the predictions for women suffer, resulting in discrimination.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

HarvardBiz /  🏆 310. in US

United States Latest News, United States Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Toblerone Is Removing the Matterhorn From Its PackagingToblerone Is Removing the Matterhorn From Its PackagingMondelez is making the change to comply with Swiss law as it moves some production outside of Switzerland.
Read more »

Washington State Senate passes bill removing penalties for retired nurses returning to workforceWashington State Senate passes bill removing penalties for retired nurses returning to workforceSenate Bill 5538 lets retired nurses work up to 1,040 hours without losing retirement benefits.
Read more »

Ransomware hackers release some stolen Oakland dataRansomware hackers release some stolen Oakland dataAn ongoing cyber attack on the city of Oakland, allegedly by the group Play Ransomware, may have left city residents' personal information vulnerable to fraud.
Read more »

Conflicting economic data limits oil price growthBullish supply-side concerns related to the war in Ukraine and China’s post-COVID...
Read more »

You won’t believe how much money hackers get from stealing your dataYou won’t believe how much money hackers get from stealing your dataEveryone uses social media and updates their information, but that information can be stolen by hackers and sold an average of $1010, according to a study by Privacy Affairs.
Read more »

Fed's Daly: If data stay hot, will need to raise rates moreFed's Daly: If data stay hot, will need to raise rates moreOver the weekend, San Francisco Federal Reserve Bank President Mary Daly said that if data on inflation and the labor market continues to come in hott
Read more »



Render Time: 2025-02-24 05:13:00