Unveiling Secrets: Sony Director Caught in Leaked Footage Engaging with AI Aloy Prototype

PlayStation is allegedly employing characters from its top franchises within an AI prototype.

A leaked video appears to show PlayStation’s director of intended engineering, Sharwin Raghoebardajal, discussing an early AI Aloy prototype.

The video – sent to The Verge but subsequently removed after a copyright claim by Sony – featured Raghoebardajal presenting a brief tech demonstration of Aloy interacting with him through prompts both within the AI prototype and in the game Horizon Forbidden West itself.

“This is merely a preview of what can be achieved,” Raghoebardajal stated, prior to showcasing how Aloy can provide players with lore and background information upon request.

Although the voice does not align with that of the in-game Aloy, the character model reacts intelligently to queries with some coordinated facial expressions and movements. According to Raghoebardajal, this is strictly an internal demonstration developed at Sony.

As per The Verge’s report, the AI design utilizes OpenAI’s tools for speech-to-text, along with GPT-4 and Llama 3 for its dialogue and decision-making capabilities, while Sony’s proprietary Mockingbird technology powers the audio-to-facial animation and emotions.