Researchers have discovered breakthrough behavior in large language models, which has implications for AI safety and potential.
Two years ago, in a project called the Beyond the Imitation Game benchmark, or BIG-bench, 450 researchers compiled a list of 204 tasks designed to test the capabilities of large language models , which power chatbots like ChatGPT. On most tasks, performance improved predictably and smoothly as the models scaled up—the larger the model, the better it got. But with other tasks, the jump in ability wasn’t smooth. The performance remained near zero for a while, then performance jumped.
Other studies found similar leaps in ability. The authors described this as “breakthrough” behavior; other researchers have likened it to a phase transition in physics, like when liquid water freezes into ice. In a paper published in August 2022, researchers noted that these behaviors are not only surprising but unpredictable, and that they should inform the evolving conversations around AI safety, potential, and ris
Breakthrough Behavior Large Language Models AI Safety Potential
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Why large language models aren’t headed toward humanlike understandingUnlike people, today's generative AI isn’t good at learning concepts that it can apply to new situations.
Read more »
Revolutionizing Software Development With Large Language ModelsSon Nguyen is the co-founder & CEO of Neurond AI, a company providing world-class Artificial Intelligence and Data Science services. Read Son Nguyen's full executive profile here.
Read more »
Large Language Models’ Emergent Abilities Are a MirageA new study suggests that sudden jumps in LLMs’ abilities are neither surprising nor unpredictable, but are actually the consequence of how we measure ability in AI.
Read more »
Language structures yield good human and computational language models.Similarities and differences between how humans and computers process language don't lie in the architecture of the processing system but in the language system itself.
Read more »
Video shows large geyser from water main break in SF's in Stern Grove areaSan Francisco workers are on the scene at 35th Avenue and Wawona Street, responding to a large water main break that happened Friday morning in Stern Grove.
Read more »
Biden says debating Trump 'depends on his behavior'President Biden on Friday said his decision on whether to debate President Trump ahead of Election Day is dependent on his opponent’s “behavior.'
Read more »