Article complete

10 Mind-Blowing Videos Created by Sora

OpenAI released Sora, a text-to-video model that crafts realistic videos from text, capturing complex scenes with accuracy.

A yellow background features a brain sculpture, film strips, a cassette, and a golden disc with code snippets.

Key takeaways

  • OpenAI's Sora generates realistic videos from text, showcasing advanced AI capabilities.
  • Currently available to select users for feedback, ensuring quality and addressing potential risks.
  • Sora uses DALL·E 3's recaptioning technique for improved scene accuracy and detail.
  • Early user creations include visually stunning videos that capture complex scenes and actions.
  • Sam Altman actively engages with users for creative prompts, highlighting community involvement.

Takeaways drafted with AI from the article text.

It’s only been a couple of days since OpenAI released Sora, its new text-to-video model, which generates realistic videos. So far, it is available exclusively to red teamers for identifying potential issues and risks, as well as to artists, designers, and filmmakers for collecting feedback on improvements.“We’re sharing our research progress early to start working with and getting feedback from people outside of OpenAI and to give the public a sense of what AI capabilities are on the horizon,” the blog said.

Yet already, there are videos on social media that’ll make you stop to find out more. The videos, up to a minute long, maintain incredible visual quality and adherence to the user’s prompt.

The model can simulate complex scenes, featuring multiple characters, specific motions, and intricate details of the subject and background. Sora uses the recaptioning technique from DALL·E 3, which involves generating highly descriptive captions for the visual training data. 

Here are some of the best examples of what Sora can create:  

A bicycle race on the ocean

As soon as the model was released, Sam Altman was taking requests from users on X to create anything they’d like to see. Kunal Shah, the founder of CRED replied with the prompt “A bicycle race on the ocean with different animals as athletes riding the bicycles with a drone camera view”

His request was fulfilled with a video that features a shark, orca, penguin, turtle, and dolphin all racing on bicycles on water, as if by magic!

White SUV on a dirt road

Jessica Lessin, the editor in chief of The Information, has a favourite video from the ones initially previewed by OpenAI. It’s been created with the prompt, “The camera follows behind a white vintage SUV with a black roof rack as it speeds up a steep dirt road surrounded by pine trees on a steep mountain slope, dust kicks up from its tires, the sunlight shines on the SUV as it speeds along the dirt road, casting a warm glow over the scene. The dirt road curves gently into the distance, with no other cars or vehicles in sight. The trees on either side of the road are redwoods, with patches of greenery scattered throughout. The car is seen from the rear following the curve with ease, making it seem as if it is on a rugged drive through the rugged terrain. The dirt road itself is surrounded by steep hills and mountains, with a clear blue sky above with wispy clouds."

The video follows the prompts to the T. 

Pirates clash inside a coffee cup

He explained that the model is likely trained on synthetic data, possibly using Unreal Engine 5. The video animates the prompt realistically, simulating fluid dynamics like coffee movement, achieving photorealism, and applying real-world physics to fantastical scenarios. 

Golden Retrievers and Snow

A garden cat

He then went on to compare the same prompt on Pika, Runway, Leonardo, FinalFrame and shared the comparative results. And they didn’t even come close!

Surfing indoors

The prompt reads, “In an ornate, historical hall, a massive tidal wave peaks and begins to crash. Two surfers, seizing the moment, skillfully navigate the face of the wave.” This bizarre request was stunningly captured by the model which was posted by the user Angry Penguin on X. He posted the video along with a few other equally bizarre options. 

This Inception-esq video gives Hollywood a run for their money. 

Snow and Sakura

Instead of planning a trip to Japan or even looking at pictures taken by travellers, Sora will give you a cinematic view of the scenery with a panoramic shot. 

A stroll in Mumbai rains

Anu Aakash an AI content creator posted a video on X of a woman with bright purple overalls and cowboy boots taking a casual stroll in the streets of Mumbai during the monsoon season.  Unsurprisingly that exactly was the prompt given to Sora. The image depth with a car moving towards the viewer with old Bombay buildings really captures the prompt. 

Minecraft with Sora

Attenborough and Sora

He pointed out that, “People aren't taking the ‘everyone will be filmmakers’ seriously enough”. 

Published

Spotted an error? Tell our editors. Read our editorial standards and corrections.

More in this story

Sora · 5 stories
  1. You are here: 10 Mind-Blowing Videos Created by Sora
  2. The 10 Best Videos Created by Luma AI
  3. Top 10 Alternatives to OpenAI's Sora
  4. Top 10 Scarily Realistic Videos Generated by Kling, the Chinese Alternative to Sora
  5. Is Runway’s Gen-3 Update the First or Last Frame?
About the author

Contributor

All stories
Belamy · Daily

The day’s AI news, before your first meeting.