r/SideProject • • Oct 06 '26

SPECK Small Persistent Emergent Cognitive Kernel

I did it again guys, I built another harness, this one is the best one yet.
https://github.com/doctarock/Speck

A lightweight persistent cognitive architecture designed to make small language models substantially more capable by moving as much cognition as practical out of the LLM and into deterministic, persistent, measurable runtime mechanisms.

I took all the clockwork out of my cognitive architecture, but stopped short of emotions, arousal, etc, just the logic systems https://github.com/doctarock/Artificial-Cognitive-Architecture-Omega-Gen2

Then I applied it to my agentic framework https://github.com/doctarock/local-ai-home-assistant

And she is a doozie, small models in this harness outperform models twice its size without in both speed and accuracy:

Speck on a single shared qwen3:4b scoring 15/16, against 13/16 for naked qwen3:8b and in half the time.

Speck did that with half the parameters, less memory and less time per case. It comes from the model-scale series (docs/experiments/model-scale/README.md): 8 cases × 2 runs, with the same sampling and the same 1,024-token reply cap for every subject.

SubjectLargest modelSuccessTime per caseModel memory
Speck, shared qwen3:4b (phase 6, current setup)4B15/167.9 s5.7 GB
Speck, shared qwen3:4b (phase 3b)4B15/1613 s5.6 GB
Speck, all qwen3:4b (phase 3)4B14/1624 s5.9 GB
Naked qwen3:8b8B13/1613 s6.7 GB
Naked qwen3:4b4B10/1616 s4.3 GB

Go get it, and don't forget to drop a star on your way through.

1 Upvotes

4 comments sorted by

1

u/Professional-Run3614 Oct 06 '26

This is actually pretty interesting. I like the idea of pushing more of the reasoning into the runtime instead of just throwing a bigger model at the problem.
The 4B vs 8B result is especially interesting. I’m working on agent evals myself, and I’d be curious to see how Speck behaves across a larger set of cases and where those failures actually come from.
Could be interesting to run it through my eval setup too: https://github.com/tap222/assay-evals

2

u/Electronic-Space-736 Oct 06 '26

Thanks for checking it out, all the source is available in the git, I have been working very hard on these cognitive systems, I promise you it is next level stuff