A new wearable AI system watches your hands through smart glasses, guiding experiments and stopping mistakes before they happen
, working on an experiment, when, as you finish one step, a display on the inside of your lab goggles tells you what to do next. A small camera in the frame watches your hands closely. If you reach for the wrong tube, the, an AI “operating system” for scientific laboratories built by the Stanford-Princeton AI Coscientist Team, a group led by Stanford University bioengineer Le Cong and Princeton University computer scientist Mengdi Wang, with founding partners that include NVIDIA.
Powered by NVIDIA’s vision-language models towith real-time knowledge of lab work so it can determine what causes experiments to fail or succeed and rapidly train new scientists to expert levels by guiding them through Walk into a wet lab, Cong says, and “it hasn’t changed much in the last 50 years.” This matters, he explains, because a large portion of the time, science is done “in the physical lab, in the physical world, not on computers.” As described in a recent preprint paper,. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today. The scientific community has long grappled with a problem that has been known for more than a decade as a “replication crisis.”, Monya Baker, then an editor for the journal, reported that “more than 70% of researchers have tried and failed to reproduce another scientist’s experiments,” and more than half couldn’t reproduce their own work. Some of that failure rate is attributable to statistical malpractice or publication pressure. But one common cause receives less attention: humans doing repetitive lab work make mistakes. A reagent added at the wrong temperature, a step skipped under time pressure, a contaminated pipette tip—these are errors that can be too small to notice but are large enough to wreck an experiment.The solution proposed by Wang and Cong’s team is an open-source platform and hardware kit that lets AI see what scientists see. Researchers in early pilot tests in Cong’s lab at Stanford and Wang’s at Princeton wear augmented reality/extended reality glasses that stream video directly to the system. LabOS compares what it sees against the written protocol, offering guidance to the wearer while also gathering training data. The AI can talk the scientist through each step, reminding them to keep a surface sterile or flagging lapses in technique. AI needs real-time knowledge of experiments to learn what works and what doesn’t, much in the same way thatand self-driving cars have to gather real-world data to update their systems. “We can have 1,000 chatbots, 1,000 AI scientists trying to tell real scientists what to do,” Wang says, but if AI isn’t wired into the physical experiment, “we never have anything verifiable.” Normally when humans do lab work, learning can be slow. If an experiment fails, they try to determine what went wrong and begin again. But when AI watches an experiment and sees the outcome, it may be able to more rapidly determine which steps caused problems and can design a new experiment. By recording entire experiments, an AI can study the smallest details to determine what caused them to fail. This oversight extends beyond human guidance; LabOS also utilizes a robotic arm to handle tedious tasks such as mixing. “It’s not like replacing people,” Cong says. “We need to help people.” So far, the assistance is yielding results. In an experimental procedure that involved increasing the amount of a certain protein in cells, junior scientists with just one week of LabOS training obtained results that were virtually indistinguishable from those of expert scientists. “I couldn’t tell the difference as a professor,” Cong says. “The results from the experiment—they’re identical.” “From a robotics and human-computer interaction perspective, this work highlights a promising direction,” says Kourosh Darvish, a scientist at the AI and Automation Lab at the University of Toronto’s Acceleration Consortium, who was not involved in LabOS development. Yet he notes the importance of developing standards to better evaluate such work. “As AI systems increasingly move from analytical tools toward active partners in experimentation, community-level standardization and validation will be critical.”, adapting their AI-and-AR architecture to assist surgeons with anatomical mapping and tool alignment. Ultimately, Wang says, the broader ambition is to turn “”—and soon, every clinic—“into an AI-perceivable and AI-operable environment,” creating a system that can train professionals faster,has served as an advocate for science and industry for 180 years, and right now may be the most critical moment in that two-century history.always educates and delights me, and inspires a sense of awe for our vast, beautiful universe. I hope it does that for you, too., you help ensure that our coverage is centered on meaningful research and discovery; that we have the resources to report on the decisions that threaten labs across the U.S.; and that we support both budding and working scientists at a time when the value of science itself too often goes unrecognized.There has never been a more important time for us to stand up and show why science matters. I hope you’ll support us in that mission.
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
This App Tells You When a Person Nearby is Wearing Smart GlassesNearby Glasses tells users when someone in their proximity is wearing a pair of Meta Ray-Bans or another brand of smart glasses.
Read more »
The smart lock standard that could replace your keys is finally hereAliro brings Apple’s Home Key features to Android phones — so you can tap-to-unlock with your Galaxy and Pixel phones, too.
Read more »
Former Georgia Bulldogs Reveals Kirby Smart Made Him Reconsider Playing FootballA former Georgia Bulldog players reveals that Kirby Smart intense coaching style made him reconsider playing college football.
Read more »
Insignia’s 55-Inch Smart Fire TV Matches 43-Inch Pricing After 43% Off on AmazonThis is an absolute steal of a TV that you'll love using.
Read more »
Larry Magid: Smart dehumidifiers help control dust mitesLarry Magid: Smart dehumidifiers help control dust mites. Dehumidifiers aren’t glamorous appliances, but dust mites aren’t exactly welcome house guests.
Read more »
Scientists build AI robots to make smart clothing easier to sort, reuse and recycleResearchers in Germany have been developing AI-powered robotic solutions to sort and recycle smart textiles more efficiently.
Read more »