Google AI learns to play open-world video games by watching them

Artificial Intelligence News

Google AI learns to play open-world video games by watching them
Video GamesAI
  • 📰 newscientist
  • ⏱ Reading Time:
  • 66 sec. here
  • 5 min. at publisher
  • 📊 Quality Score:
  • News: 37%
  • Publisher: 51%

An artificial intelligence from Google DeepMind can play nine open-world video games like a human, by watching video from a screen and controlling a keyboard and mouse

, like a human just by watching video from a screen, which could be a step towards generally intelligent AIs that operate in the corporeal world., but these games have obvious ways to win or lose, making it relatively straightforward to train an AI to succeed at them., are harder for AI systems to crack.

Besse and his colleagues used pre-existing video and image recognition models to interpret game video data, then trained SIMA to map what happens in the video to certain tasks. To provide this information, the researchers got pairs of people to play video games together, with one person watching the screen and telling the other what moves to make, and also made people watch back their gameplay and describe the mouse and keyboard moves they performed for their game actions.

When SIMA was trained on eight games, the researchers found it could then play a ninth game that it hadn’t seen before. However, it fell short of human-level performance. The researchers used a training method in which they rotated which eight games they trained the AI on so using the ninth game was the test, to ensure it can play any of the games it hasn’t seen before.

“It’s worth remembering that for companies like DeepMind, this research isn’t really about games, it’s about robotics,” saysat King’s College London. “Navigating 3D environments is a means to an end, and these companies are keen to make AI systems that can perceive and act in the world. So I don’t see this having a large impact on video games, but it might have a lot of unknown impacts on our life outside in the real world.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

newscientist /  🏆 541. in US

Video Games AI

United States Latest News, United States Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Google DeepMind's Veo 2 Takes on OpenAI in Video GenerationGoogle DeepMind's Veo 2 Takes on OpenAI in Video GenerationGoogle DeepMind's new AI model, Veo 2, aims to outshine OpenAI in video generation. Capable of producing high-resolution, longer videos, Veo 2 boasts improved physics understanding and camera control, resulting in clearer and more cinematic footage.
Read more »

Google DeepMind's Genie 2 can generate interactive 3D worldsGoogle DeepMind's Genie 2 can generate interactive 3D worldsAfter double majoring in unemployment (English and Art History), Igor’s career prospects were, to say the least, limited. It was either become a teacher or a writer. Thankfully, he went with the latter.
Read more »

The Morning After: Google DeepMind’s Genie 2 can generate interactive 3D worldsThe Morning After: Google DeepMind’s Genie 2 can generate interactive 3D worldsMat Smith heads up Engadget’s daily newsletter from London, UK. He has worked at Engadget for over a decade and has covered console gaming, flagship smartphones, the Apple Watch and fitness tech that promises to make him faster or stronger. He’s currently learning how to backflip.
Read more »

Navigating the Challenges of AI Implementation: A Guide from Google DeepMindNavigating the Challenges of AI Implementation: A Guide from Google DeepMindThis article explores the common hurdles organizations face when implementing AI, such as data scarcity, solution overload, and unclear objectives. Drawing on Google DeepMind's experience, it provides practical advice on identifying suitable AI applications, adapting solutions to imperfect contexts, and prioritizing projects with the greatest potential benefit for businesses or society.
Read more »

Navigating the Challenges of AI Adoption: A Guide from Google DeepMindNavigating the Challenges of AI Adoption: A Guide from Google DeepMindThis article explores the common obstacles organizations face when implementing AI, such as data scarcity, solution complexity, and unclear objectives. Drawing on the expertise of Google DeepMind, it offers practical guidance on identifying suitable AI applications, finding solutions for challenging contexts, and prioritizing projects that deliver maximum benefits to businesses and society.
Read more »

Navigating the Challenges of AI Implementation: Google DeepMind's Insights and GuidanceNavigating the Challenges of AI Implementation: Google DeepMind's Insights and GuidanceThis article explores the common obstacles organizations encounter when implementing AI and offers solutions and guidance from Google DeepMind. It emphasizes the importance of identifying suitable problems for AI, finding solutions in contexts where AI may not be the ideal fit, and selecting projects with the highest potential impact.
Read more »



Render Time: 2025-02-16 13:38:21