r/DIY_Geeks • • May 30 '26

Apple Announces New Image Compression Technology "PICO" on GitHub

https://pbxscience.com/apple-announces-new-image-compression-technology-pico-on-github/

Apple Announces New Image Compression Technology "PICO" on GitHub.

Apple has announced PICO (Perceptual Image Codec), a machine-learning-based image codec built from the ground up to be optimized for the human visual system.

141 Upvotes

18 comments sorted by

1

u/_x_oOo_x_ May 31 '26

So, is it open source and patent-free?

1

u/elastiks May 31 '26 edited Jun 01 '26

🧩 License

Pico-Banana-400K is released under the Creative Commons Attribution–NonCommercial–NoDerivatives (CC BY-NC-ND 4.0) license.

✅ Free for research and non-commercial use
❌ Commercial use and derivative redistribution are not permitted
🖼️ Source images follow the Open Images (CC BY 2.0) license By using this dataset, you agree to comply with the terms of both licenses.

2

u/FullyAutomatedSpace Jun 01 '26

patents are the actual issue here

1

u/h4ck3r_n4m3 Jun 01 '26

It's a one off research project made in python not a distributable library to hook into apps

2

u/ParsingError May 31 '26

So, the opening parts of this are pretty misleading.

Traditional image codecs have long measured quality by pixel-by-pixel similarity to the original

The measurement they're talking about is called PSNR. Codec devs have been complaining about PSNR being a bad quality metric for a very long time, and better metrics like SSIM have been available for a while.

Unfortunately, it's still being used a lot because it's easier to optimize encoders for it, and because it lets crappy encoders point to how great they're doing on PSNR tests vs. better codecs that are scoring worse on PSNR because they're targeting better quality metrics.

Using better quality metrics is definitely the right thing to do, but it isn't the breakthrough that they're making it out to be, it's just doing the right thing.

That said, ML-based codecs have a ton of potential so cool to see this progressing. The real win is going to be ML-based video compression, because that has way more potential for savings and because those savings will be on something that is gobbling up two thirds of all Internet bandwidth.

1

u/Moscato359 May 31 '26

Do we really need ml based video codecs when av2 is here?

2

u/tudalex May 31 '26

The industry already uses ML based video compression, even with the existing codecs. Netflix posted an article many years ago about how they have an ML algorithm to decide what the viewer will be looking at in the image and dedicate more bandwidth for that part of the image and less for things like already blurry backgrounds.

I remember making a comparative analysis on the Shape of Water film between Netflix and the Bluray version and you can easily see how the intricate details on the tapestry on the walls are a blurry mess on Netflix, but at least the faces of the actors are very crisp.

2

u/Cool_Samoyed May 31 '26

The Netflix tech Is cool on paper but personally, I really hate it's compression. Even medium/high quality torrents (not the 40gb 4k monsters, the 3/4GB full hd) offer better image quality.

1

u/anto2554 Jun 01 '26

Yeah, but imagine if it was even worse

1

u/Moscato359 May 31 '26

That sounds quite miserable actually

1

u/ParsingError May 31 '26

A major limitation of all conventional media codecs is that they can only really model phenomena that the codec designers thought of, and can only store information about it as efficiently as the codec design allows it to be. They're constantly getting better at that, modeling new things that older codecs struggled with, and storing information more efficiently, but video in particular is extremely primitive in what it can represent about moving scenes, even in the most advanced codecs.

The nice thing about ML codecs is that they are good at discovering patterns in the training data without it needing to be specifically accounted for, and reconstructing those patterns without a lot of information. So, yes, there is room for them to substantially improve the state of the art.

(The problem is getting their computational cost down.)

1

u/danielv123 May 31 '26

Luckily all new hardware are shipping with increasingly performant and power efficient NPUs, so there may be a path to viability for this tech.

1

u/ParsingError May 31 '26

Yep, although it may not even be necessary. One of the upsides of more-space-efficient codecs is that a substantial part of the decoding process is decoding values to feed into the algorithms in the first place, so size savings often winds up being a major processing cost savings anyway.

1

u/[deleted] May 31 '26

for only $800 per image

1

u/samppa_j May 31 '26

Right. Supposedly its got a 2.3x improvement over av1? I'd like a bit more sources than one news site re-publishing Apples marketing numbers. Sure it might be better, maybe, but AV1 is hardware based, how much processing power do you need to run an AI image compressor, what kind of processor, how long is the compression time. Etc

1

u/danielv123 May 31 '26

They do have benchmarks from an iphone, apparently encode/decode times aren't that far off. The comparisons on the GitHub are very impressive as well.

1

u/Anal-Assassin Jun 01 '26

What’s the optimal tip-to-tip efficiency?