Meta just announced Movie Gen, a powerful new suite of AI models for generating and editing video and audio content

META

Meta just announced Movie Gen, a powerful new suite of AI models for generating and editing video and audio content, positioning itself as a direct competitor to OpenAI’s Sora and other industry leaders.

The details:

Movie Gen consists of four models: a 30B video generation model, a 13B audio model, a personalized video model, and a video editing model.
The system can generate HD videos up to 16 seconds long from text prompts, along with synchronized audio like sound effects and background music.
Movie Gen also features video editing via natural text prompts and the ability to upload a reference image to create personalized videos.
Meta claims the model outperforms rivals like Runway Gen3, Luma Labs, and OpenAI’s Sora in human video quality and consistency evaluations.
Meta CEO Mark Zuckerberg said that Movie Gen will be ‘coming to Instagram next year’ in a postdisplaying some of the model’s sample generations.

Meta’s Movie Gen separates itself from other video generators by not only generating videos from text, but also being able to perform precise video editing. With the models coming to Instagram, it could transform the content creation process and give the masses a powerful video editing suite—with only prompting required.

2 comments