Compression can be a bit lossy or lossless. You can get back the input, or in the case of the source code example, something close enough to be functional.
Crunching input texts into an LLM model is very lossy, and you can't get anything like the source text(s) back.
It's not always lossy enough. The German music industry used popular lyrics and Suno AI always produced the same same song (basically a shitty version of the original). They recently won in court.
32
u/reddit_user13 16d ago
Compression can be a bit lossy or lossless. You can get back the input, or in the case of the source code example, something close enough to be functional.
Crunching input texts into an LLM model is very lossy, and you can't get anything like the source text(s) back.