Sora Preview: OpenAI’s Text to Video Surprise!

OpenAI created quite a stir with its new text-to-video model, Sora, which I’ll demo for you in this video.

You’ll quickly understand why filmmaker Tyler Perry decided to scrap an $800 million expansion of his 330-acre film studio after he saw what you’ll see here.

As we watch the video samples, I’ll cover some of the surprising achievements of Sora, including:

-3D consistency of characters as the camera pans in various directions

-The ability for characters and visual style to persist across shots, even if they go out of view temporarily.

You’ll also see several example of actual text prompts and the resulting videos.

And you’ll also see an example of video in multiple formats, plus an example of a still image being animated.

In the course of the demo, we’ll also cover how a diffusion model like this works, and we’ll talk about OpenAI’s recaptioning method as applied to rich descriptions, which is an enabler for the successful results that you’ll see.