In October 2024, Meta introduced Movie Gen, an artificial intelligence tool designed to revolutionize the creation of videos generated from text. This advanced technology allows users to create high-quality video clips simply with a written prompt, opening new possibilities for content creators, filmmakers, and social media users on platforms like Instagram, Facebook, and WhatsApp.

Main Technological Features

Movie Gen uses a 30-billion-parameter transformer model, allowing it to create videos up to 16 seconds long at a speed of 16 frames per second. What sets this tool apart from other technologies is its ability to understand object motion dynamics, interactions between subjects and the camera, and generate plausible motions for a wide variety of concepts. In this sense, Meta has designed Movie Gen to be capable of generating videos that are not only realistic but also incorporate a deep understanding of visual context and its relationship with the provided text.

Advanced Editing and Audio Generation

In addition to generating videos from scratch, Movie Gen allows users to edit existing videos with text. This includes local modifications, such as adding or removing specific elements of a clip, as well as global changes, such as altering the background or the general visual style of the video. Meta’s AI ensures that modifications only affect the necessary pixels, preserving the integrity of the original content.

In the field of audio creation, Movie Gen uses a 13-billion-parameter model that generates soundtracks synchronized with the videos. This includes sound effects, instrumental music, and ambient sounds, all tailored to the generated or edited visual content. The technology ensures that the audio perfectly matches the rhythm and narrative of the video, enhancing immersion and overall quality.

Implications and Future of Movie Gen

Although Movie Gen is not yet available to the general public, Meta is working closely with filmmakers and content creators to refine the model and gather valuable feedback. When released, this tool is expected to compete directly with other advanced video generation technologies such as OpenAI's Sora and Google DeepMind's Veo.

Meta's vision with Movie Gen is clear: democratize video creation by making it faster, more accessible, and affordable. This could have a significant impact on the film industry by offering a more efficient and cost-effective alternative for producing audiovisual content. In the near future, users are expected to integrate this technology into their social networks, allowing them to create and edit clips for Instagram Reels or send personalized videos via WhatsApp.