As the RTX 30 series cards welcome a new generation of graphics, visuals and processing, Nvidia also aims to strengthen its grip in the field of streaming. In recent news, NVIDIA has launched a new disruptive plugin named Nvidia Broadcast, which provides solutions that have left the competition reeling.
Being announced and released alongside the RTX 30 series cards, Nvidia broadcast utilises AI tensor cores to provide a professional streaming setup for those who use Nvidia cards. The snowball leading up to the release of this streaming plugin started to roll earlier last year when they launched a beta of the RTX voice application, providing its users with background noise-free audio.
Sign up for your weekly dose of what's up in emerging technology.
Team green has also stated that its encoder (NVIDIA NVENC) is also a key element in making sure this plugin was possible even to be made in the first place. Coming with an assurance that it can provide a streamer set up to those who cannot afford to have one, Nvidia broadcast provides:
- Noise removal
- A virtual background without the help of a green screen
- Even the ability to auto frame a subject
These features put the Nvidia Broadcast plugin leagues beyond the competition and puts the company in a unique position. It uses AI’s power through the tensor cores located within any Nvidia Geforce RTX, Titan RTX, or Quadro RTX GPU. It all runs in real-time hence it will run smoothly alongside your games or the application you wish to stream.
The backbone of Nvidia’s new plugin approach is the feedback that team green received when releasing the beta version of RTX voice. With said response and various optimisations to the Tensor core, Nvidia has reduced the cost of performance of the AI network, making the plugin to be more efficient and effective in noise cancellation.
Going in further depth about the features that make it stand out from the competition is the auto framing capability that comes with artificial intelligence to track your head movements to ensure that you will always be the centre of action in your webcam space. To facilitate this, the AI identifies the facial features, including shapes, lips, eyes, and other 126 key points for face landmark tracking, and the GPU accelerated optimisation uses the 3D morphable model to create a face mesh.
While on the other hand, virtual background ensures that the space behind you is covered by pictorial media, which provides the cover-up for your room. In other words, it gives the same solution as a green or blue screen but without any drapes hanging behind you. Furthermore, the app also enables real-time 3D tracking of a person’s face, allowing developers to create engaging augmented reality effects on the subject’s face.
Nvidia has also stated that its plugin can be used universally with all the various broadcasting software such as Open Broadcast Systems (OBS), XSplit, and even Discord during a webcam. With the Broadcast app’s dedicated hardware encoding and decoding, one can unlock the full potential of streaming apps. Not only does it reduce the FPS impact of streaming by up to 50%, but it also delivers 15% better efficiency for H.264 encoding and 25% for HEVC encoding compared to prior generations.
The Bigger Picture
Looking at its competition — Logitech’s capture software can track you with auto framing while applications like Zoom and ManyCam provide users with a virtual background solution. At the same time, Krisp ensures clean, noise-free audio. Unfortunately, the biggest and simplest flaw in all of them is that they don’t provide a common solution for all the problems a streamer faces which is finally catered by Nvidia Broadcast.
Though if you want to try out a portion of Nvidia Broadcast, an updated and patched version of RTX voice is available for all GPU’s. Nevertheless, Nvidia has stated that mileage will vary for older cards.
Watching the demonstration of the Nvidia Broadcast was impressive as well as promising. Looking at the forums also highlights a new step in the direction of streaming. Being littered with various issues, the application works, but as we know, the first step is always the most wobbly. Irrespective of further refinements and optimisations, Nvidia Broadcast claims to be the go-to plugin for all streamers who wish to access a professional stream studio for free.