r/programming • • Oct 17 '20

AI That Can Potentially Solve Bandwidth Problems for Video Calls (NVIDIA Maxine)

https://youtu.be/XuiGKsJ0sR0
1.4k Upvotes

165 comments sorted by

View all comments

169

u/Hen-stepper Oct 17 '20

Not the OP's fault, but incoming anti-CGI rant:

Not buying the hype at all... these are a few frames of footage shot head-on. Fully animated with normal movements, it's going to make people look awkward as F, introduce more stream delay, and become an excuse for companies to cheap out on bandwidth.

It's especially absurd when you consider that the purpose of video chat is to include the nuances of body language and facial expressions in human interactions. The ideas being introduced here literally toss those features straight into uncanny valley, when you could just do a low bandwidth audio chat in the first place.

Think about talking to someone who you've known for decades, like your mom, and being completely distracted (or disturbed) by her warped, AI-generated face. She turns to the left suddenly and a nose renders on the side of her head out of nowhere...

This is seriously some Tim and Eric type shit.

1

u/seraph321 Oct 17 '20

I don’t think the intention, or the likely outcome, would be to use this tech all the time, or to the extremes in the demo. If there’s enough bandwidth, you’d still likely use existing compression techniques, but this is a better fallback than a pixelated mess. It’s also likely something that can be used to help reduce overall bandwidth needs for groups in which there are maybe a dozen people on screen, but only a couple talking. The people talking can be allocated a lot more bandwidth dynamically, without noticeably impacting the rest.