MITB Banner

Adobe Adds OpenAI’s Sora, RunwayML, and Pika to Premiere Pro

Adobe is also developing a new Firefly Video Model

Share

Listen to this story

Adobe has announced plans to integrate third-party generative AI tools, including OpenAI’s Sora, into its popular video editing software Premiere Pro.

Adobe is exploring partnerships with leading AI providers like OpenAI’s Sora, RunwayML, and Pika. This open approach aims to give users the flexibility to choose AI models that best suit their workflow needs, the company said in its blog. 

Deepa Subramaniam, Adobe’s vice president of product marketing for creative professional apps, said that Adobe hasn’t finalised the revenue-sharing arrangement for third-party AI tools on its platform.

The US-based software company also announced that it is developing a new Firefly Video Model that will join the already released Firefly Image, Vector, Design, and Text Effects Models. 

Adobe is providing a compensation of $120 to its community of photographers and artists for submitting videos depicting ordinary activities like walking or various emotions such as joy and anger to train its model, according to recent reports

​​Adobe is seeking over 100 short clips of people in actions, emotions, and simple anatomy shots, excluding copyrighted or offensive content. The payment averages $2.62 to $7.25 per minute of submitted video.

The company has also introduced new generative AI tools to Premiere Pro, one of which is Generative Extend. This tool can be used to make shots a little longer by generating entirely new frames at the beginning or end of a clip.

New AI tools in Premiere Pro, like Object Addition/Removal, simplify object editing in shots by replacing moving objects, removing unwanted items, or adding set dressings. Generative B-Roll feature creates custom video clips with simple text prompts, reducing time spent on finding suitable footage.

Adobe is also introducing ‘Content Credentials,’ which will label the videos created by generative AI and specify the models used in the media that users are viewing. Content Credentials will be supported inside Premiere Pro, to help create a chain of trust from creation to editing to publication.

Share
Picture of Siddharth Jindal

Siddharth Jindal

Siddharth is a media graduate who loves to explore tech through journalism and putting forward ideas worth pondering about in the era of artificial intelligence.
Related Posts

CORPORATE TRAINING PROGRAMS ON GENERATIVE AI

Generative AI Skilling for Enterprises

Our customized corporate training program on Generative AI provides a unique opportunity to empower, retain, and advance your talent.

Upcoming Large format Conference

May 30 and 31, 2024 | 📍 Bangalore, India

Download the easiest way to
stay informed

Subscribe to The Belamy: Our Weekly Newsletter

Biggest AI stories, delivered to your inbox every week.

AI Courses & Careers

Become a Certified Generative AI Engineer

AI Forum for India

Our Discord Community for AI Ecosystem, In collaboration with NVIDIA. 

Flagship Events

Rising 2024 | DE&I in Tech Summit

April 4 and 5, 2024 | 📍 Hilton Convention Center, Manyata Tech Park, Bangalore

MachineCon GCC Summit 2024

June 28 2024 | 📍Bangalore, India

MachineCon USA 2024

26 July 2024 | 583 Park Avenue, New York

Cypher India 2024

September 25-27, 2024 | 📍Bangalore, India

Cypher USA 2024

Nov 21-22 2024 | 📍Santa Clara Convention Center, California, USA

Data Engineering Summit 2024

May 30 and 31, 2024 | 📍 Bangalore, India

Subscribe to Our Newsletter

The Belamy, our weekly Newsletter is a rage. Just enter your email below.