Meta, the parent company of Facebook, has unveiled a groundbreaking AI model called Movie Gen, which can generate realistic video and audio clips in response to user prompts. The announcement, made on Friday, positions Movie Gen as a competitor to established media generation tools from companies like OpenAI and ElevenLabs.
The samples shared by Meta showcase the model’s capabilities, producing videos of animals swimming, surfing, and even incorporating real photos of individuals engaged in various activities, such as painting. Notably, Movie Gen can also generate synchronized background music and sound effects tailored to the video content, allowing for enhanced creative editing of existing footage.
For example, the tool demonstrated its editing prowess by adding pom-poms to a man running alone in a desert, while another clip transformed a parking lot scene with a skateboarder into a splashy puddle setting. Videos produced by Movie Gen can last up to 16 seconds, with audio clips extending to 45 seconds.
Also Read: Unveiling the Xiaomi 15 and Honor Magic 7: Release Dates and Key Features
Meta claims that blind tests indicate Movie Gen performs favorably against offerings from other startups, including Runway, OpenAI, ElevenLabs, and Kling. This announcement arrives at a time when Hollywood is grappling with how to effectively leverage generative AI video technology. Earlier this year, Microsoft-backed OpenAI showcased its product Sora, which can create feature film-quality videos from text prompts.
While technologists in the entertainment sector are eager to adopt such tools for streamlining the filmmaking process, there are concerns regarding the potential misuse of AI-generated content, particularly regarding copyright issues. Additionally, lawmakers are increasingly worried about the impact of AI-generated deepfakes, which have been linked to elections in countries like the U.S., Pakistan, India, and Indonesia.
