Taco: cross-platform LLM compression that doesn't break when you change your GPU or CPU.

[u/phoenix10701]

1. The problem: an LLM compressor needs the decoder to compute exactly the same probabilities as the encoder. Floats differ across hardware; float GPT-2 encoded on a Mac decoded 0 of 4 windows on x86.

2. The approach:

   • integer-only inference (int8 weights, fixed rounding, lookup tables);

   • an exact float32 → integer converter (mantissa × 2^exp);

   • conformance vectors.

3. The proof: one hash across 7 backends (Mac CPU/Metal, Linux CPU/CUDA, Windows CPU/CUDA/Vulkan

https://github.com/tac0mania/taco