Imagine an artificial intelligence (AI) model that can watch and understand moving images with the subtlety of a human brain. Now, scientists have made this a reality by creating MovieNet: an innovative AI that processes videos much like how our brains interpret real-life scenes as they unfold over time.
Imagine an artificial intelligence model that can watch and understand moving images with the subtlety of a human brain. Now, scientists have made this a reality by creating MovieNet: an innovative AI that processes videos much like how our brains interpret real-life scenes as they unfold over time.
To create MovieNet, Cline and first author Masaki Hiramoto, a staff scientist at Scripps Research, examined how the brain processes real-world scenes as short sequences, similar to movie clips. Specifically, the researchers studied how tadpole neurons responded to visual stimuli. The researchers also found that the tadpoles' optic tectum neurons distinguished subtle changes in visual stimuli over time, capturing information in roughly 100 to 600 millisecond dynamic clips rather than still frames. These neurons are highly sensitive to patterns of light and shadow, and each neuron's response to a specific part of the visual field helps construct a detailed map of a scene to form a"movie clip.
"By mimicking the brain, we've managed to make our AI far less demanding, paving the way for models that aren't just powerful but sustainable," says Cline."This efficiency also opens the door to scaling up AI in fields where conventional methods are costly."
Neuroscience Perception Physics Optics Medical Technology Neural Interfaces Computer Modeling Artificial Intelligence
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
MovieNet: Breakthrough AI decodes videos like a human brain with 82% accuracyBy simulating how the human brain processes a moving world, Scripps researchers have reached a breakthrough in AI as current models only recognize still images.
Read more »
'I can't imagine what happened': Relative remembers woman killed in tractor-trailer crashFamily of a woman struck and killed by a tractor-trailer in York County earlier this month say the woman recently moved to the area to care for a loved one.
Read more »
This Veterans Day, let’s imagine a veterans health and wellness village in Center CityWhat if the dormant Hahnemann University Hospital properties in Center City were modernized and repurposed into a veterans health and wellness village focused on comprehensive care?
Read more »
All We Imagine As Light lingers on intimacy in the monsoon-drenched rat raceWriter-director Payal Kapadia’s Grand Prix-winner, All We Imagine As Light considers the bonds between women in a slow-burn, lyrical drama.
Read more »
2084: Creating a Dystopian Hell on Earth That Even Orwell Could Not ImagineTom Engelhardt, co-founder of the American Empire Project, runs the Type Media Center's TomDispatch.com.
Read more »
‘All We Imagine as Light’ review: A luminous slice of Mumbai lifeThe rhythms of bustling, working-class Mumbai are brought to vivid life in “All We Imagine as Light.” The narrative debut of filmmaker Payal Kapadia explores the lives of three women at different stages in their life in the city.
Read more »