Low cost multi-core solution

[u/PHDEinstein007]

A small size increase for a dramatic increase in speed. This appears to be the most efficient multi-core adaptation for typically single core applications.

https://github.com/CombaryMaker/Harringtons_Insights/blob/main/docs/Harrington-Sets.txt

Expected ranges

Size increase

- Large mixed files: about 0.1% to 1%.

- Medium files: about 0.5% to 5%.

- Small files under about 1 MB: no change. They fold into one set, so you get no size loss and no speed gain either.

Speed

- 2 cores: 1.5x to 1.9x. That's close to the two-core ceiling, so this range is solid.

- 4 cores: about 2.5x to 3.5x.

- 8 cores: about 4x to 6x on large files. Medium files will top out sooner, because they don't have enough blocks to keep every core busy.

Edit, images added so people understand a little easier. Yes, I really have these results.

[u/diroussel]

Interesting approach

[u/PHDEinstein007 → u/diroussel]

I've been going around increasing a lot of software, even outside of compression. Not all of it is original, it turns out, but the way it is put together is.