University College London researchers have reconstructed 10-second video clips from the mice's brain activity alone.
University College London researchers have achieved a fascinating leap in neural decoding.The team reconstructed 10-second video clips from the mice’s brain activity alone. While previous studies have used fMRI in humans, this study used single-cell recordings to achieve much higher precision.
“We wanted to have a better way of investigating how the brain interprets what we see, said Dr. Joel Bauer, the lead author from the Sainsbury Wellcome Centre at UCL, in a press release on March 10.“The current methods of understanding what specific groups of neurons are representing are not very generalisable to situations that haven’t been specifically tested for. And so, we wanted to develop a method that can capture what is being represented in the brain and compare that to reality,” Bauer added.Single-cell recordingsIn recent years, researchers have attempted to reverse-engineer brain signals back into digital pixels by using fMRI machines to monitor subjects as they watch images or films. This ongoing global effort aims to map exactly how our neural pathways translate raw data from the eye into the coherent mental representations we recognize as sight.This new approach differs in that it uses single-cell recordings in the visual cortex while playing videos to mice.The process relied on a “dynamic neural encoding model.” This predictive model maps how individual neurons respond to specific movie frames. Interestingly, the model also factors in the mouse’s physical behavior — such as body movement and pupil dilation — to ensure the reconstruction accounts for how the animal’s internal state and actions influence its perception.For sharp reconstruction, the team tracked localized boosts in calcium levels to see which cells were on.The mouse’s actual neural firing was compared against the predicted activity of a brain seeing a blank screen. By starting with a blank digital canvas and using an algorithm to “update” pixels based on neural deviations, the team refined the output until it mirrored the mouse’s actual visual experience.Mapping the brain After training the model, 10-second videos were generated using only the neural signals recorded while a mouse watched entirely new footage. Dr. Bauer noted that the quality of these reconstructions scaled with the volume of data. The more individual neurons they tracked, the more accurate the final video became.Further, the accuracy of the reconstruction was verified using pixel correlation, a statistical method that compares the original footage to the AI-generated version frame-by-frame.Perhaps the most startling discovery isn’t the video’s clarity, but the errors within it. Lead author notes that our brains — and those of mice — don’t actually act like perfect cameras.“We don’t have a perfect representation of the world in our heads. The visual processing pipeline skews and warps our representation in a way that modifies information,” Dr. Bauer concluded. “This deviation between reality and representations in the brain is not necessarily an error but a feature, the author explained. The brain, it seems, isn’t just recording the world; it’s interpreting it, augmenting certain cues while ignoring others to help the animal survive.For now, the team is focusing on upping the resolution. They want a wider view and a sharper image. And want to see the world exactly as the mind intends it to be seen — warps, wobbles, and all.This technology could eventually help us understand how different species perceive the world uniquely. It could also shed light on visual impairments or neurological conditions where the brain’s “editing” process goes haywire.The findings were published in the journal eLife.
Brain Modeling Fmri Health Mice Mouse Brain Neural Firing Video Clips Visual Cortex
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Scientists tracked faint signals from the stars — and may have turned up hundreds of undiscovered planetsAbha Jain is a freelance science writer. She did a masters degree in biology, specializing in neuroscience, from the Indian Institute of Science, Bengaluru, India, and is almost through with a bachelor's degree in archaeology from the University of Leicester, UK.
Read more »
Scientists Say This Sneaky Factor Impacts Brain Health, Increases Alzheimer’s RiskNew research suggests one environmental factor may increase your risk of heart disease and Alzheimer’s disease: air pollution. Here's what you need to know.
Read more »
Fall asleep faster — and sleep more deeply — by eating more of this, say scientistsToday's Video Headlines: 03/08/25
Read more »
Scientists Explain Whether You Should Take Aspirin to Prevent Colorectal CancerPeople at risk of colorectal cancer are sometimes prescribed daily aspirin. Scientists look into that preventative possibility and safety for everyone.
Read more »
Scientists Discover a Virus Hidden in Gut Bacteria That May Double Colorectal Cancer RiskScientists found a virus hidden in gut bacteria that may double colorectal cancer risk, according to a new study. Here, an oncologist explains the findings.
Read more »
US scientists could shrink wireless tech after making magnets behave like grapheneScientists in the US have created magnonic crystals that replicate graphene-like electron behavior using engineered magnetic spin waves.
Read more »