Artificial intelligence (AI) detection tools are biased against non-native English speakers and falsely accuse them of cheating, according to a Stanford study.
Johns Hopkins University professor Taylor Hahn first noticed the issue when he got an alert while grading an international student’s paper, according to aProfessor Hahn has uploaded the student’s paper to the software tool, Turnitin, which is reportedly used by over 16,000 academic institutions across the world to find plagiarism — and more recently, to spot AI-generated text.
“This student, immediately, without prior notice that this was an AI concern, they showed me drafts, PDFs with highlighter over them,” Hahn recalled of his meeting with the student.In another instance, Hahn had worked directly with a non-native English speaking student on an outline and drafts for a paper, only to later find that Turnitin flagged the majority of the paper as generated by AI.
While the Stanford study did not involve Turnitin, it did find that seven other AI-detecting tools had flagged writing by non-native English speakers 61 percent of the time, with the incorrect assessment being unanimous on approximately 20 percent of the papers. One theory as to why this bias is occurring with AI detectors is the reality that these tools are typically programmed to flag content when the word choice is predictable and simple — a pattern that non-native English speakers are more likely to exhibit in their writing.
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Hayward police arrest man with pot, arsenal of weapons, burglary tools, 'Chucky' mask after traffic stopPolice in Hayward on Wednesday announced the recent arrest of a man on probation who was caught during a traffic stop with almost two pounds of pot, an arsenal of weapons including a machete and a 'medieval style club with metal spikes' and a Chucky mask.
Read more »
ACC progressing toward expansion, with Stanford, Cal and SMU potential targetsThe Atlantic Coast Conference is making progress toward an expansion that could grab Stanford and California from the sinking Pac-12, a source told the AP.
Read more »
Khari Reid becomes first Neumann Goretti football player to commit to Stanford UniversityKhari Reid is making history as the first football player at Philly’s Neumann Goretti High School to commit to Stanford University. NBC10’s Matt Delucia spoke with Khari, Khari’s mother, and long time Neumann Goretti head coach Albie Crosby about the massive achievement.
Read more »
Stanford football: Former Syracuse QB’s transfer to The Farm could be important step for CardinalStanford football gets rare transfer portal boost at quarterback in former Syracuse QB Justin Lamson.
Read more »