Editor’s Note: This post is part of our weekly In the NVIDIA studio series, which celebrates star artists, offers creative tips and tricks, and shows how Nvidia Studio technology improves creative workflows. In the coming weeks, we’ll be taking an in-depth look at the new features, technologies, and resources of the GeForce RTX 40-Series GPU, and how they dramatically speed up content creation.
TwitchCon – the world’s largest gathering of live streamers – kicks off Friday with the new line of GeForce RTX 40-Series GPUs bringing incredible new technology – from AV1 to AI – to improve live streams for Twitch creators in grass and professionals.
Plus, creator and educator EposVox is in the NVIDIA studio to discuss his influences, inspiration, and tips for getting the most out of live streams.
Plus, join the #From2Dto3D challenge this month by sharing a 2D artwork alongside a 3D rendition of it for a chance to be featured on NVIDIA Studio’s social media channels. Be sure to tag #From2Dto3D to participate.
AV1 and finished
Released on October 12, the new GeForce RTX 40-series GPUs feature NVIDIA’s eighth generation video encoder, NVENC for short, which now supports AV1 encoding. For creators like EposVox, the new AV1 encoder will deliver 40% increased efficiency, unlocking higher resolutions and sharper image quality.
NVIDIA has worked with OBS Studio to add AV1 support to its next software release, expected later this month. Additionally, Discord is enabling AV1 end-to-end for the first time later this year. Owners of the GeForce RTX 40 series will be able to stream in crisp, clear image quality at 1440p and even 4K resolution at 60 frames per second.
The GeForce RTX 40-series GPUs also feature dual encoders. This allows creators to capture up to 8K60. And when it’s time to cut a live stream VOD, the two encoders work in tandem, dividing the work automatically, cutting export times nearly in half. Blackmagic Design’s DaVinci Resolve, the popular Voukoder plug-in for Adobe Premiere Pro, and Jianying, China’s top video editing app, all enable dual encoder via encoding presets. Expect the availability of the dual encoder for these applications in October.
GeForce RTX 40-Series GPUs also offer game streamers an unprecedented generation-over-gen frame rate boost in PC gaming, along with new NVIDIA DLSS 3 technology, which accelerates performance by up to at 4x. This will unlock richer and more immersive ray tracing experiences to share via live streams, as in Cyberpunk 2077 and Portal with RTX.
Virtual live streams come to life
VTube Studio is a leading application for virtual streamers (VTubers) that makes it easy and fun to bring digital avatars to life on a live stream.
VTube Studio adds support for the NVIDIA Broadcast AR SDK this month, allowing users to seamlessly control their avatars with AI using a standard webcam and GeForce RTX GPU.
Objectively Happy Streaming
OBS doesn’t represent objectively happy streaming, but it should.
OBS Studio is free open source software for video recording and live streaming. It’s one of EposVox’s core apps, as he says it “allows me to produce my content at a fast pace that is constantly changing.”
The software now features native integration of AI-powered NVIDIA broadcast effects, including virtual background, noise removal, and room echo cancellation.
In addition to adding AV1 support for GeForce RTX 40-series GPUs later this month, the recent OBS 28.0 release added support for High Efficiency Video Coding (HEVC or H.265), improving 15% video compression rates across a wide range from NVIDIA. GPUs. It also now includes support for high dynamic range (HDR), providing a greater range of bright and dark colors, which brings stunning vibrancy and dramatic improvements in visual quality.
Broadcast for all
The SDKs that power NVIDIA Broadcast are available to developers, enabling native support for AI functionality in devices ranging from Logitech, Corsair, and Elgato, as well as advanced workflows in OBS and Notch software.
Features released last month on NVIDIA GTC include new and updated AI-powered effects.
The virtual background now includes time information, so random objects in the background will no longer cause blinking distractions. This will be available in the next major version of OBS Studio.
Face Expression Estimation allows applications to accurately track facial expressions for face meshes with even the simplest of webcams. It is extremely beneficial for VTubers and can be found in the next version of VTube Studio.
Eye Contact allows podcasters to appear as if they are looking directly at the camera, which is very useful when the user is reading a script or looking away to engage with viewers in the chat window.
This is the world of EposVox, we all live in it
Adam Taylor, who goes by the stage name EposVox or “The Stream Professor,” runs a YouTube channel focused on tech education for content creators and streamers.
He made videos long before YouTube existed.
“DailyMotion, Google Video, anyone remember MetaCafe? X-Fire?” says EposVox.
He maintains a strong passion for educational content, which stemmed from his desire to learn video editing workflows as a young man, when he lacked the wealth of knowledge and resources available today.
“I immediately encountered constant walls of information that were kept behind closed doors when it came to deeper video topics, audio setups and more,” the artist said. “It was really frustrating – there was nothing and no one, other than a decade or two of DOOM9 forums and outdated broadcast books, who had never heard of a USB port to help me guide.”
While content creation and live streaming, especially with software like OBS Studio and XSplit, are EposVox’s primary goals, it also aspires to make technology more fun and easy to use.
“GPU acceleration in 3D and video applications, and now all the AI innovations that are coming to new generations, are amazing – I’m not sure I’d be able to create at the level that I do, or at the speed to which I do, without NVIDIA GPUs.
When seeking content inspiration, EposVox takes a proactive approach – it’s all about asking questions. “Whether it’s trying to figure out how to make a new exaggerated setup for myself, breaking down the neat effects I see elsewhere, or just wondering what point in the process might cause friction for a viewer – I asks questions, I find the best way to answer those questions and deliver them to viewers,” he said.
EposVox emphasized the importance of experimenting with multiple creative applications, noting that “every tool I can add to my toolkit enhances my creativity by giving me more options or ways to create, and more experiences with new creative processes. This is especially true for the use of AI in his creative workflows, he added.
“What I love about the AI art generation right now is the fact that I can just type in any idea that comes to mind, in plain language, and see it. come to life,” he said. “I may not get exactly what I expected, I may have to keep refining my language and my ideas to approach the representation I seek – but breaking down the barrier between conception of the idea and seeing a form of this idea in front of me, I can’t overstate the impact that’s being created here.
For the best live streaming setup, EposVox recommends a PC with a GeForce RTX GPU. Its GeForce RTX 3090 desktop GPU, he said, can handle the rigors of the entire creative process and stay fast even when constantly switching between computationally complex creative applications.
The artist said, “These days, I use GPU-accelerated NVENC encoding to capture, export video, and live stream.”
EposVox can’t wait for its GeForce RTX 4090 GPU upgrade, mainly to take advantage of the new dual encoders, noting “I’ll probably end up saving a few hours a day as less wait time on renders and downloads means I can go from project to project much faster, rather than having to walk away and work on other things. I will be able to concentrate a lot more.
When asked for starting tips, EposVox didn’t hesitate: “If you commit to a creative vision for a project, but the entity you’re doing it for – the company, agency, the person or whoever – takes the project in a whole different direction, find a way to bring your vision to life,” he said. “You’ll be so much better off – in terms of how you feel and experience gained – if you can still bring this to life.”
For more tips on live streaming and video exports, check out the EposVox YouTube channel.
And for step-by-step tutorials for all creative fields — created by industry-leading artists and community showcases — check out the NVIDIA Studio YouTube channel.
Finally, join the #From2Dto3D challenge by posting on Instagram, Twitter or facebook.
🟪 It’s time to show how your artwork went from 2D to 3D (just like @juliestrator)!
Join our October #From2Dto3D challenge by sharing a 2D artwork alongside a 3D artwork you created for a chance to be featured on our channels. 🖼️🖼️
— NVIDIA Studio (@NVIDIAStudio) October 3, 2022
Get updates straight to your inbox by subscribing to NVIDIA Studio Newsletter.