Google DeepMind introduces SIMA, an AI-based virtual gaming partner: Know what all it can do

livemint.com:

Google, SIMA is equipped with the ability to assimilate gaming skills through natural language instruction and image recognition. It analyzes various gaming environments to strategize and execute actions in pursuit of specified goals.

Unlike conventional gaming bots, SIMA emulates human-like gameplay, responding to instructions and navigating game scenarios with agility and precision. Currently, SIMA has mastered over 600 fundamental gaming skills, encompassing tasks such as navigation, object interaction, and even piloting vehicles.

Google emphasizes that while achieving high game scores is not the primary focus, the ability of SIMA to learn and adapt across diverse gaming settings holds immense promise for the development of highly capable AI agents capable of assisting users in various environments. In a bid to further enhance SIMA's capabilities, Google has forged partnerships with eight prominent game studios, providing the AI agent with access to a myriad of gaming experiences.

SIMA has been put to the test across nine different games, including popular titles like No Man's Sky and Teardown. Each game serves as a learning opportunity, exposing SIMA to varied gaming setups and enabling the acquisition of essential skills such as resource management and navigation.

To facilitate SIMA's learning process and foster decision-making, Google has collaborated with four research environments, including a novel Unity engine environment where the agent was challenged to sculpt, demonstrating its comprehension and adaptability. Additionally, Google conducted experiments involving human players, with one player engaging in gameplay while the other provided instructions to SIMA, refining the agent's predictive capabilities.