Meta is bringing AI video tricks to Instagram, with new features that let users edit their videos just by using text to tweak images — from adding shine to changing backgrounds, and doing almost anything you can imagine.

“I'm very excited about Movie Gen, our early model of AI research that will allow you to change almost any aspect of your videos with a simple text message,” Adam Mosseri, head of Instagram, said in a statement. Video ad.

The video shows Mosseri in his original clothes and setting – a gray jacket and an ordinary-looking bedroom – and the scene begins to change randomly, showing him in Paris, New York, and a swimming pool, and changing his clothes into different things. Like a leather jacket or puffer jacket while in the Himalayas.

“You should be able to change your clothes or change the context you're sitting in, or add a chain, whatever you can think of,” Mosseri explained, showing demonstrations in which he seamlessly switched backgrounds and changed his appearance.

dead Announce Movie Gen has been showcasing for a few months some generations that have surpassed the output of other models in terms of quality and speed commitment. The company also showcased some AI-generated Instagram clips created by social media influencers like Big Biscayneand social media branding 10pm curfew girls and K5sh the accounts.

Besides generative video, Movie Gen deals with video painting, changing specific things within the video while leaving all other elements intact. This makes the model extremely versatile, giving users the ability to do a lot of different visual manipulations, from changing a person's clothing to swapping backgrounds, and even turning people into doll-like cartoon versions of themselves by manipulating the overall style of the model. scene

The technology appears to be based on Meta's Movie Gen AI model, which Decryption I mentioned on last year. It's the company's answer to similar tools from competitors, like OpenAI's recently announced Sora video generator, and Runway's com. inpainting feature, and even some open source tools such as The painter.

For Instagram, this marks the first time Meta has brought video AI capabilities directly to users. Movie Gen can create brand new 16-second videos or edit existing videos, complete with sound effects and synchronized music.

The generative video scene has been booming lately, with some pretty significant developments announced in recent months after a fairly quiet year with spaced-out releases.

Sora was finally released, but there were a lot of interesting alternatives - like Invideo V3 (which is able to create entire scripts, scenes and 10-minute videos from a single idea), and Dream Machine (which can create cohesive scripts and realistic videos even in surreal scenarios). , Google's Veo2 (capable of creating hyper-realistic videos with great immediacy), and Showrunner (capable of creating tiny cartoons).

Meta did not announce a specific launch date, but Mosseri said it would come in 2024.

Modified by Andrew Hayward