Nvidia's RTX broadcast engine leverages GeForce AI cores to beautify your game streams

Nvidia unveiled Tuesday, TwitchCon, RTX Broadcast Engine, a set of SDK using artificial intelligence to offer virtual greenscreens, augmented reality effects and style filters that developers can add to their streaming software. Nvidia may have loaded its GeForce RTX 20 graphics card with dedicated RT and Tensor cores to accelerate real-time ray tracing in games, but it now puts the automatic learning chops of these tensor cores back into the game. place practical work for video creators.

Nvidia

The performance of RTX Greenscreen is the same as that of virtual green screens built into Logitech C922 and Razer Stargazer webcams, with more consistent results, hopefully. It intelligently removes the background of your webcam feed, leaving only your body and your face on the screen, displaying the game flow behind you.

The images provided by Nvidia seem clear and crisp, but the aforementioned webcams show that the proof will be for the better. If the technology works well, it could cancel the special features of Logitech and Razer, and perhaps even the need to create an expensive physical green screen. We'll see. He will arrive soon at OBS.

Nvidia

Like Greenscreen, RTX AR detects your face, including the movement of individual functions. "Developers can use it to create fun and engaging AR effects, such as superimposing 3D content on a face or allowing a person to control 3D characters with their face," Nvidia says.

Nvidia

RTX style filters can transform the look of your webcam stream to mimic the style of a reference picture. The above example of Nvidia gives the thread, including the banner itself, the atmosphere of Van Gogh's iconic icon. Starry Night The painting. The company's Ansel "super screen capture" image filters can provide similar effects in games, even though Ansel does not need tensor hearts to function magically.

These new features require developers to add them to their streaming software. We will have to see how much they are adopted. The addition of RTX Greenscreen to OBS, one of the most popular Twitch streaming programs in the world, is a good start. The executives of StreamLabs and XSplit provided ready-made quotes expressing their enthusiasm for incorporating the features of Nvidia RTX Broadcast Engine into their own software.

Nvidia

Exploiting the RTU GPU's built-in tensor cores for such effects is a clever way to make GeForce more attractive to broadcasters, especially on the back of the superb RTX encoder. Over the past month, Twitch Studio, Elgato, and Discord have all introduced features that also support the Nvidia Fast Codec SDK.

If you are at TwitchCon, you can see RTX Greenscreen in action in OBS, booth 1823. Our guide to the best graphics cards for PC games can help you choose the right GeForce GPU. youIf that makes you want to upgrade to the top, then our beginner's guide to streaming Twitch can help you get started on the celebrity streaming path.