OpenAI's text generator wrote academic abstracts convincing enough to repeatedly get past human readers. It could mean trouble for scientific publishing.
“Our reviewers knew that some of the abstracts they were being given were fake, so they were very suspicious,” said lead researcher, Catherine Gao, a pulmonologist Northwestern’s medical school, in. “This is not someone reading an abstract in the wild. The fact that our reviewers still missed the AI-generated ones 32% of the time means these abstracts are really good.
In addition to running the abstracts by human reviewers, the study authors also fed all of the samples, real and fake, through an AI output detector. The automated detector successfully, routinely assigned much higher scores to the ChatGPT abstracts than the real ones. The AI detector rightfully scored all but two of the original abstracts as close to 0% fake.
and different types of studies use very different numbers of subjects. The generated abstracts used similar patient cohort sizes as the corresponding originals, wrote the study authors. “For a study on hypertension, which is common, ChatGPT included tens of thousands of patients in the cohort, while a study on a monkeypox had a much smaller number of participants,” said the press statement.number of reviewers were small. They only tested one AI output detector.
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
'Enough is enough': Chicago area doctors call for Illinois lawmakers to pass assault weapons banChicago area doctors called for Illinois lawmakers to vote for an assault weapons ban as the state Senate meets to consider the gun control bill.
Read more »
Should I worry that ChatGPT will take over my column?Artificial intelligence is an exciting and dangerous new realm. But be careful what you wish for.
Read more »
Microsoft looking at OpenAI’s GPT for Word, Outlook, and PowerPointMicrosoft also working on ChatGPT-like features for Bing.
Read more »
Microsoft might integrate ChatGPT AI into Outlook, Word | Digital TrendsThere is word that Microsoft is in collaboration with OpenAI to use its GPT model to bring AI text generation to its Office suite.
Read more »
A Mental Health App Tested ChatGPT on Its UsersKoko used GPT-3 to counsel 4,000 people but shut the test down because 'it felt kind of sterile.' Users rated the AI responses highly. Cue the Twitter backlash.
Read more »
Microsoft in talks to invest $10 bln in ChatGPT owner -SemaforMicrosoft Corp is said to be in talks to invest $10 billion into OpenAI, the owner of ChatGPT, Semafor reported on Monday, citing people familiar with the matter.
Read more »