Runway just unveiled Act-One, a new Gen-3 Alpha video feature that allows creators to map real human facial expressions onto AI-generated characters using a single video and reference image — without any specialized equipment. The details:
- The system captures nuanced performances, including micro-expressions and eye movements, using just a smartphone video and character reference image.
- Act-One allows creators to transfer the single video performance across multiple AI characters in different styles and angles.
- The tool integrates directly with Runway's Gen-3 Alpha video model for creating complex narrative scenes.
- The release follows Runway's recent partnership with Lionsgate to develop custom AI models using their film catalog.
Professional-quality character animation was labor and equipment-intensive, time-consuming, and expensive in the past. Runway’s new tool now gives anyone the ability to craft expressive, believable characters, smashing down yet another barrier to entry for creative storytelling.