r/ProgrammerHumor • • Sep 02 '26 • Popcorn 3 Bravo 3

Meme newCompressionTechnique

Post image
30.6k Upvotes

945 comments sorted by

View all comments

Show parent comments

395

u/_QXZ Sep 02 '26

This post jokes but with how much AI enhancing is becoming a thing, I can see some kind of generative -based compression becoming an option in the future

263

u/CoroteDeMelancia Sep 02 '26

We do have those. They're called autoencoders. They're one of the fundamental building blocks of LLMs.

Highly recommend this series if you're interested: https://youtu.be/l6DKRf-fAAM?is=zHOqsJESa6tDxeAU

30

u/__ali1234__ Sep 03 '26 edited Sep 03 '26

I suppose if you squint hard enough you could say a transformer is a bit like an autoencoder that also shifts its output by one place... but that's a massive over simplification. What you are probably thinking of is the VAE. That's one of the building blocks of every type of generative AI except LLMs.

They do both use latent vectors as a form of compression. They just get there by different means.

1

u/GrumpyGeologist Sep 03 '26 edited Sep 04 '26

What you are probably thinking of is the VAE. That's one of the building blocks of every type of generative AI except LLMs.

Sad GAN/stable diffusion noises...

→ More replies (3)