Leaked Internal Sony Video Uses Horizon's Aloy to Show AI-Powered PlayStation Character Prototype

A leaked internal Sony video reveals ongoing experiments with AI-powered PlayStation characters. The Verge reported on this video, allegedly from PlayStation Studios' advanced technology group, showcasing Aloy from the *Horizon* games as an AI character. The video's removal from YouTube following a copyright claim from Muso (a company listing Sony Interactive Entertainment as a client) suggests its legitimacy. IGN has reached out to Sony for comment.

The video, as detailed by The Verge, features Sony Interactive Entertainment's director of software engineering, Sharwin Raghoebardajal, conversing with an AI-powered Aloy. This conversation utilizes OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) for speech, and Sony's Mockingbird technology for facial animation.

The AI Aloy's voice differs from voice actress Ashly Burch's portrayal, instead employing a robotic text-to-speech quality. Her facial animations are stiff and lack expressiveness. During the conversation, Aloy reveals her identity as a clone of Dr. Elizabeth Sobeck, and discusses her feelings about this revelation.

The demo transitions into the *Horizon Forbidden West* game world, continuing the conversation within the game environment. This interaction, where the player converses with a character they control, presents a notable juxtaposition. The irony of using Aloy, given the *Horizon* storyline, is also apparent.

The prototype, developed with Guerrilla Games, serves as an internal demonstration of Sony's AI capabilities. While the video showcases Sony's investment in AI-powered characters, no plans for public integration have been confirmed, and its feasibility with current PS5 games remains unclear.

Sony's exploration of AI isn't surprising, given the industry-wide focus on this technology. Microsoft, for example, recently unveiled Muse, an AI designed for game design ideation. However, generative AI faces criticism regarding ethical concerns, rights issues, and its ability to consistently produce high-quality, enjoyable content. Keywords Studios' failed experiment in creating an entirely AI-driven game highlights these challenges.

Despite this, companies like EA and Capcom are actively exploring AI's potential. EA considers AI "the very core" of its business, while Capcom utilizes it for generating ideas for game environments. Asad Qizilbash of PlayStation Productions emphasized AI's importance for Gen Z and Gen Alpha gamers, highlighting the desire for personalized gaming experiences.

Activision's recent admission of using generative AI for some *Call of Duty: Black Ops 6* assets, following a backlash over an AI-generated loading screen, further illustrates the complex relationship between AI and game development.

### What's The Best PlayStation 5 Game?

### Pick a winner

New duel1ST2ND3RDSee your ResultsFinish playing for your personal results or see the community’s!Continue playingSee results