MITB Banner

Artist Becomes Creative With Omniverse, Uses AI To Make Videos With Singing Digital Humans

Brazilian artist creates ‘Bad Moon Rising’ using NVIDIA Omniverse and its AI-powered Audio2Face application

Share

Brazil-based 3D generalist and freelance video editor, Anderson Rohr, has created a lip-synced cover of ‘Bad Moon Rising,’ the 1960s anthem from Creedence Clearwater Revival. He created this using NVIDIA Omniverse and its AI-powered Audio2Face application.

To make the video, Rohr used the NVIDIA Studio system with GeForce RTX 3090 GPU. For this project, Rohr recorded himself singing and then opened the file in Audio2Face. The application on Omniverse uses instantly generated expressive facial animations for the digital human with only an audio source or a voice-over track.

He then manually animated the brows, eyes, and neck of the character and changed the lighting for the scene. For Rohr, the NVIDIA Omniverse speeds up the workflow and helps achieve more natural digital humans. With the work done fast and so many new horizons, artists can spend more time on the creative process.

Without the Omniverse, animations can take as long as 300 hours to render. Rohr also faced software incompatibilities that slowed his work. With Omniverse and its connectors for software applications, renderings are achieved in real-time.

Artists can supercharge their creations with Omniverse, NVIDIA Studio – its optimized RTX-accelerated hardware and software drivers, and AI and simulation features.

Share
Picture of Meeta Ramnani

Meeta Ramnani

Meeta’s interest lies in finding out real practical applications of technology. At AIM, she writes stories that question the new inventions and the need to develop them. She believes that technology has and will continue to change the world very fast and that it is no more ‘cool’ to be ‘old-school’. If people don’t update themselves with the technology, they will surely be left behind.
Related Posts

CORPORATE TRAINING PROGRAMS ON GENERATIVE AI

Generative AI Skilling for Enterprises

Our customized corporate training program on Generative AI provides a unique opportunity to empower, retain, and advance your talent.

Upcoming Large format Conference

May 30 and 31, 2024 | 📍 Bangalore, India

Download the easiest way to
stay informed

Subscribe to The Belamy: Our Weekly Newsletter

Biggest AI stories, delivered to your inbox every week.

AI Courses & Careers

Become a Certified Generative AI Engineer

AI Forum for India

Our Discord Community for AI Ecosystem, In collaboration with NVIDIA. 

Flagship Events

Rising 2024 | DE&I in Tech Summit

April 4 and 5, 2024 | 📍 Hilton Convention Center, Manyata Tech Park, Bangalore

MachineCon GCC Summit 2024

June 28 2024 | 📍Bangalore, India

MachineCon USA 2024

26 July 2024 | 583 Park Avenue, New York

Cypher India 2024

September 25-27, 2024 | 📍Bangalore, India

Cypher USA 2024

Nov 21-22 2024 | 📍Santa Clara Convention Center, California, USA

Data Engineering Summit 2024

May 30 and 31, 2024 | 📍 Bangalore, India

Subscribe to Our Newsletter

The Belamy, our weekly Newsletter is a rage. Just enter your email below.