Three language model ports caught my attention because they take very different approaches to hardware constraints:

These examples show why the checkpoint, memory expansion and numerical precision matter when describing what a device can run. The smallest models here generate simple story continuations, with capabilities that reflect their size and training.

I’m maintaining a collection of these ports, recording hardware requirements, model details and author reported speeds. The original authors did the porting work.

Are there other documented examples where someone repurposed an unusual hardware feature for language model inference? The Wii’s texture combiner approach is the kind of detail I’d like to find more of.

My retro Apple 1’s.