Tuesday, March 21, 2023

The company behind Stable Diffusion has released an AI tool that creates films from text


 Runway isn't going to open-source the model like Stable Diffusion and isn't going to release it widely for the first time for safety and business reasons.


An AI model has been released by Runway, the company that co-created the well-known Stable Diffusion AI image generator. It takes any text description, such as "turtles flying in the sky," and generates three seconds of video footage that matches it.


Runway isn't going to open-source the model like Stable Diffusion and isn't going to release it widely for the first time for safety and business reasons. The text-to-video model, which is called Gen-2, will initially be available on the Runway website through a waitlist on Discord.


It is not new to use AI to generate videos from text inputs. At the end of last year, research papers on text-to-video AI models were published by Google and Meta Platforms Inc. However, Runway's text-to-video AI model is being made available to the general public, according to Runway's chief executive Cristobal Valenzuela.


According to Valenzuela, Runway hopes that creatives and filmmakers will utilize the product.

Catch Daily Highlights In Your Email

* indicates required

Post Top Ad