XSplit have put it in their live streaming client ( download): NVIDIA Broadcast Noise Removal is in two places. ![]() But AI sound processing techniques are the first time we really see a reason you’d want to leave the CPU for the GPU. That’s something that’s been talked about for a long time, and even surfaced in some experimental applications. This is doubly interesting, as you get GPU-bound calculations in audio. ![]() So while everyone is obsessed with whether AI can write music (it can’t, also why would you want that?, but mainly, it really can’t), AI is actually doing something that really worked poorly in the past with conventional DSP techniques. It also does noise removalĪI in NVIDIA Broadcast Engine is also doing work on the audio side – here, with noise removal. It’s coming in two weeks, so… check shipping times on those NVIDIA GPUs, probably. Lower latencies versus the CPU, which added 2-3 frames this is apparently sub-frame so … wow!.A real-time 3D morphable model with 6000 polygons and 6 degrees of head movement (good, as I recently had to go to a physical therapist when COVID-19 initially murdered my spine).More features, detected via machine learning – “contour, face shape, lips, eyes, and eyelids, using up to 126 key points.”.NVIDIA are using the muscle on their silicon to do the unthinkable, and use machine learning to basically replace expensive green screen-and-camera rigs.ĭorky video, but check the background replacement: So forget all the absolutely terrible background replacement in Zoom calls you’ve been enduring. Who would have thought, combining AMD CPUs and NVIDIA GPUs would be the thing in 2020?)īut the good news is, this is a broadcast-quality tool that’s now available for peanuts. (Note that what it doesn’t require is a beefy CPU, of course – and that stupidly cheap yet very speedy Ryzen from NVIDIA’s own rival AMD winds up being a great pairing. Think NVIDIA GeForce RTX 2060, Quadro RTX 3000, TITAN RTX or higher. Like so many things in 2020 and in live video applications, blah blah, something about gamers (appropriately there’s some dude in I guess a gaming chair?) – but this isn’t actually just for gamers once you dive in.įirst, the bad news – that cool looking app with all its dynamic face tracking and background removal and so on does require a higher-end NVIDIA GPU. It all starts with the NVIDIA Broadcast App. Broadcast App which is very much not Zoom But they quietly made three announcements today you might easily have missed.Īnd all of this is a big deal for people working on streaming and digital art and audiovisual performance. ![]() NVIDIA has been the belle of the ball this year, with insanely powerful GPUs and accompanying features. Let’s get the cool futuristic sci-fi stuff, too, and use it in streams, eh? Face tracking in Notch, noise removal in VST3, and hardware-accelerated video transmission without capture cards. We’ve gotten the suck-y, boring dystopian future.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |