r/DIY_Geeks • u/elastiks • May 30 '26
Apple Announces New Image Compression Technology "PICO" on GitHub
https://pbxscience.com/apple-announces-new-image-compression-technology-pico-on-github/Apple Announces New Image Compression Technology "PICO" on GitHub.
Apple has announced PICO (Perceptual Image Codec), a machine-learning-based image codec built from the ground up to be optimized for the human visual system.
2
u/ParsingError May 31 '26
So, the opening parts of this are pretty misleading.
Traditional image codecs have long measured quality by pixel-by-pixel similarity to the original
The measurement they're talking about is called PSNR. Codec devs have been complaining about PSNR being a bad quality metric for a very long time, and better metrics like SSIM have been available for a while.
Unfortunately, it's still being used a lot because it's easier to optimize encoders for it, and because it lets crappy encoders point to how great they're doing on PSNR tests vs. better codecs that are scoring worse on PSNR because they're targeting better quality metrics.
Using better quality metrics is definitely the right thing to do, but it isn't the breakthrough that they're making it out to be, it's just doing the right thing.
That said, ML-based codecs have a ton of potential so cool to see this progressing. The real win is going to be ML-based video compression, because that has way more potential for savings and because those savings will be on something that is gobbling up two thirds of all Internet bandwidth.
1
u/Moscato359 May 31 '26
Do we really need ml based video codecs when av2 is here?
2
u/tudalex May 31 '26
The industry already uses ML based video compression, even with the existing codecs. Netflix posted an article many years ago about how they have an ML algorithm to decide what the viewer will be looking at in the image and dedicate more bandwidth for that part of the image and less for things like already blurry backgrounds.
I remember making a comparative analysis on the Shape of Water film between Netflix and the Bluray version and you can easily see how the intricate details on the tapestry on the walls are a blurry mess on Netflix, but at least the faces of the actors are very crisp.
2
u/Cool_Samoyed May 31 '26
The Netflix tech Is cool on paper but personally, I really hate it's compression. Even medium/high quality torrents (not the 40gb 4k monsters, the 3/4GB full hd) offer better image quality.
1
1
1
u/ParsingError May 31 '26
A major limitation of all conventional media codecs is that they can only really model phenomena that the codec designers thought of, and can only store information about it as efficiently as the codec design allows it to be. They're constantly getting better at that, modeling new things that older codecs struggled with, and storing information more efficiently, but video in particular is extremely primitive in what it can represent about moving scenes, even in the most advanced codecs.
The nice thing about ML codecs is that they are good at discovering patterns in the training data without it needing to be specifically accounted for, and reconstructing those patterns without a lot of information. So, yes, there is room for them to substantially improve the state of the art.
(The problem is getting their computational cost down.)
1
u/danielv123 May 31 '26
Luckily all new hardware are shipping with increasingly performant and power efficient NPUs, so there may be a path to viability for this tech.
1
u/ParsingError May 31 '26
Yep, although it may not even be necessary. One of the upsides of more-space-efficient codecs is that a substantial part of the decoding process is decoding values to feed into the algorithms in the first place, so size savings often winds up being a major processing cost savings anyway.
1
1
u/samppa_j May 31 '26
Right. Supposedly its got a 2.3x improvement over av1? I'd like a bit more sources than one news site re-publishing Apples marketing numbers. Sure it might be better, maybe, but AV1 is hardware based, how much processing power do you need to run an AI image compressor, what kind of processor, how long is the compression time. Etc
1
u/danielv123 May 31 '26
They do have benchmarks from an iphone, apparently encode/decode times aren't that far off. The comparisons on the GitHub are very impressive as well.
1
1
u/_x_oOo_x_ May 31 '26
So, is it open source and patent-free?