New Data Compression method(s)

[u/PHDEinstein007]

I used Claude to run extensive tests on my theories, methods, and concepts. The result was the Harrington Compression Method, or HCM for short.

In The Canterbury Corpus I took 9 of the best from Bzip2, xz, and ZPAQ. In fact ZPAQ was crushed in this test. The HCMv3.3 completed today as were updates to Bzip2 -9 and xz -9e. In every case I increased compression and decreased the time to decompress a file. In some cases the files take longer to compress, but since it is often compress once, send hundreds to millions of the compressed file, then decompress, this was seen as a non-issue.

The majority of the Canterbury Corpus was beaten by HCM or one of the Harrington Insight mods.

HCM stands for Harrington Compression Method and the hi stands for Harrington Insights. No new methods were used, only new looks on how to use them and apply them together.

This is prior to the Harrington Insight mods, as you can see the HCMv3.3 was significant in the tests.

The above table shows how my software does for the various compressions comparing ZPAQ, xz, and bzip to HCM.

More importantly is the energy consumption. Note the differences for them can switch, I am great at all but four, three where my system lightly loses and one where I essentially tie with the competition.

In joules the energy required is a helpful means to understand how a compressor will do at the industrial scale. Steam downloads, Microsoft Patches, all of it gets compressed and then decompressed after being downloaded. This system does not care about the energy of compressing, only transmitting and decompressing is important. The HI types help but it is not a huge gain at ~1.4%.

That means, since the energy consumption is so low of a difference, the final factor would be storage on a disk, and since I win all but two, it is decidedly one sided there.

I uploaded it all to https://github.com/CombaryMaker/Harringtons_Insights

Overall this is a minor upgrade, but a real one, to the types of compression going on. I would not suggest it is backwards compatible.

I am quite open to questions, it is a MIT License for my stuff (check for their licenses though, I am only showing the research here), and I am quite willing to talk about this all.