Ubisoft Unveils Groundbreaking NEO NPC Project at Game Developers Conference

6 months ago 1121

During the Game Developers Conference, Ubisoft showcased its NEO NPC project. This project involves the development of non-player characters (NPCs) that have the ability to engage in real-time conversations with players using generative AI technology. The project draws inspiration from techniques pioneered by Nvidia and Inworld AI.

Ubisoft's team of developers in Paris is diligently working on the NEO NPC project, as stated in a blog post by the company. The goal of this project is to allow players to have authentic and dynamic conversations with NPCs in games, rather than relying solely on predetermined dialogue options. It is important to note that these NPCs are currently in the prototype stage, and Ubisoft has not provided any information on when we can expect to see them implemented in actual gameplay.

One of the key components of the project is the advanced language model developed by Inworld AI, in conjunction with Nvidia's Audio2Face technology. Players can communicate with an NPC using a microphone, which converts their spoken words into text. This text is then processed by Inworld's language model to determine the NPC's responses and behavior. A text-to-speech program is used to verbalize these responses, while Nvidia's Audio2Face technology ensures that the NPC's facial movements synchronize with the spoken words.

While Ubisoft is at the forefront of integrating generative AI into NPC interactions, other companies have also ventured into this innovative space. Nvidia showcased a similar technology demo last year called the Avatar Cloud Engine for Games, featuring an NPC named Jin working at a noodle shop. Square Enix and NetEase have also expressed interest in utilizing generative AI to enhance game development processes and create unique game assets.