Sony explores AI in gaming with interactive characters
Sony is actively exploring the potential of artificial intelligence in video games, developing prototypes of AI-powered characters, Kazinform News Agency correspondent reports, citing The Verge.
he company showcased a version of Aloy from Horizon Forbidden West that can engage in dialogue with players through voice commands.
A video presented by Sharwin Raghoebardajal, director of software development at Sony Interactive Entertainment, demonstrated how Aloy responds to player questions using a synthesized voice and facial expressions. The video was later removed due to a copyright claim from Muso, a copyrights enforcement company which advertises Sony Interactive Entertainment as a client.
To implement this technology, Sony used OpenAI Whisper for speech-to-text conversion, GPT-4 and Llama 3 for dialogue processing, as well as its own proprietary systems—Emotional Voice Synthesis (EVS) for speech generation and Mockingbird for facial animation.
While the demonstration was conducted on a PC, Sony also tested the technology on PS5 consoles, reporting minimal impact on performance. The project remains in the prototype stage and is aimed at exploring AI’s potential in game development, raising questions about its impact on voice actors and game developers.
Other companies are pursuing similar initiatives: Nvidia is working on AI-powered NPCs, while Microsoft is partnering with Inworld AI to integrate generative AI into gaming.
Earlier, Kazinform News Agency reported on fighting poverty and environmental threats using AI.
