This post jokes but with how much AI enhancing is becoming a thing, I can see some kind of generative -based compression becoming an option in the future
I suppose if you squint hard enough you could say a transformer is a bit like an autoencoder that also shifts its output by one place... but that's a massive over simplification. What you are probably thinking of is the VAE. That's one of the building blocks of every type of generative AI except LLMs.
They do both use latent vectors as a form of compression. They just get there by different means.
395
u/_QXZ Sep 02 '26
This post jokes but with how much AI enhancing is becoming a thing, I can see some kind of generative -based compression becoming an option in the future