
State-of-the-art diffusion transformer (DiT) model designed specifically for creating professional studio-grade, avatar-based video ads — available today on Creatify.
Aurora – Audio-Driven Ultra-Realistic Rendering of Reactive Avatars – is a breakthrough in generative AI that brings images to life, designed specifically for advertisers, marketers, and content creators seeking professional studio-grade video quality. Give Aurora a single photo of a person (real or AI-generated) and an audio clip of speech or song, and it will generate a high-fidelity, studio-quality video of that person speaking or singing. This multimodal foundation model for avatar synthesis is built with our core users in mind—advertisers, marketers, and content creators—delivering ultra-realistic expressive avatars that move and emote just like real humans.
Imagine a still portrait suddenly smiling, blinking, and belting out a melody – all from one image and an audio file. Aurora makes this possible, opening up a new frontier in content creation and virtual storytelling.
Through benchmarking against other methods, we found that Aurora has the following strengths:








At the core of Aurora is a diffusion-based multimodal foundation model purpose-built for generative avatar synthesis. We employ a novel architecture that includes an image encoder, a text encoder, and an audio encoder to process information from different modalities. We fuse all this information together to generate an avatar with motions that align with the audio and text input. To ensure effective fusion, we designed a special modality information exchange channel so that all modalities are well-aligned and integrated in the latent space. This novel architecture allows our model to capture subtle details in human expressions. It leverages the emotional cues in the audio to generate a visual output that mirrors natural human reactions.
Diffusion models synthesize video by iteratively refining images, which helps Aurora maintain photorealistic detail and temporal coherence in every frame. The result is smooth, natural motion without the jarring glitches or unnatural artifacts that plagued earlier methods. From subtle eye blinks to the texture of skin and hair, Aurora’s realism is powered by state-of-the-art generative science. Early testers have been amazed at how natural and expressive the videos from Aurora are, even when compared to real footage. The avatars maintain eye contact and gesture at appropriate moments, all while closely resembling the person in the original photo. For advertisers and creators alike, this level of realism is crucial—viewers stay immersed and engaged when visuals feel real, which is especially beneficial in marketing videos.
The key difference between Aurora and prior lip-sync models is that Aurora doesn’t just lip-sync – it brings full human expressiveness into the digital avatar. The generated avatars exhibit lifelike facial expressions, head movements, and even upper-body gestures – for example, they might raise an eyebrow, nod along, or use their hands for emphasis while talking. These nuances make the avatar’s performance feel authentic and engaging.
Traditional talking-head generators often looked static or only moved the mouth, but Aurora animates the entire persona. The avatar can shift its gaze, blink naturally, and perform realistic hand movements in sync with the speech. This level of expressiveness means Aurora’s avatars communicate beyond words, conveying tone and emotion through body language. Every smile, frown, or shrug is generated to match the context, so the result is an avatar that behaves like a real person on camera rather than an animated puppet. With such realistic motion, an Aurora avatar could even serve as a convincing on-screen spokesperson in a commercial, delivering a brand’s message with human-like authenticity.
One of Aurora’s most remarkable features is that you only need a single image to create a video. With just one photo as reference, Aurora can generate a coherent, realistic video of that person speaking or singing for as long as you have audio or text script. There’s no need to capture multiple angles or train a model on hours of footage of the person—Aurora works zero-shot: simply upload a picture along with an audio clip or script, and the model will do the rest.
Despite having only one image, the model preserves the character’s identity and appearance across every frame. The avatar’s face and body stay on-model (no morphing into someone else or drifting off-model) thanks to Aurora’s design. There’s no specialized setup needed; a casual smartphone photo or even an AI-drawn character portrait is enough to unleash Aurora’s capabilities. This dramatically lowers the barrier for anyone—from indie creators to marketing teams—to create high-quality avatar videos—it's as simple as selecting a picture, adding an audio clip, and letting Aurora generate the performance.
Aurora’s ultra-realistic, audio-driven avatars open the door to countless applications. Here are a few ways advertisers, marketers, and creators can use Aurora:
Aurora ushers in a new era where creating a realistic talking video is as simple as having a photo and something to say.
Our goal is to push the boundaries of ultra-realistic avatar animation, making it look as if the person in the image is genuinely alive, expressive, and communicating in the video. We are excited to launch Aurora for creators, advertisers, and marketers who want to leverage this capability. We believe it will be a powerful tool for storytelling, communication, digital marketing, and innovation. We can’t wait to see what you will create with it, and we’re eager to continue improving the model with your input.
The line between the real and the virtual continues to blur, and with Aurora, your digital self can speak as vividly as you can. For our marketing partners, this means being able to deliver ultra-realistic video content that captures audience attention and boosts campaign performance. After all, the highest quality video often leads to better conversion in ads. Welcome to the future of natural and expressive avatars!