Google DeepMind unveiled its latest AI gaming agent, SIMA (Scalable Instructable Multiworld Agent), on Wednesday. This groundbreaking AI is designed to comprehend natural language instructions and execute tasks within video game environments, essentially becoming your gaming companion.SIMA signals a potential future where AI agents become integral parts of gaming experiences, offering intelligent collaboration not only within virtual realms but also potentially in real-world tasks. This unveiling adds to a flurry of recent AI advancements, including AI companions for seniors combating loneliness and fully autonomous AI software engineers.

Described as an AI Agent distinct from conventional AI models like OpenAI’s ChatGPT or Google Gemini, SIMA boasts versatility in performing various tasks across different virtual environments. It acts as a digital explorer, capable of understanding user commands and assisting in tasks ranging from dungeon exploration to castle construction, all while continuously learning and improving through interactions with users.

To equip SIMA with diverse skills and understanding, Google DeepMind collaborated with eight game studios, exposing it to nine different video games. This immersive training process enabled SIMA to navigate complexities like simple navigation, resource mining, and even flying spaceships across varied gaming landscapes. Additionally, research environments like the Construction Lab in Unity tested its object manipulation abilities, marking a significant leap in AI’s adaptability and usefulness beyond conventional gaming scenarios.