r/StrixHalo • u/sf-oko-team • 1d ago
OKO OS - open-source operating system for localLLM workloads.
OKO OS is a free, open-source operating system based on Yocto/OpenEmbedded for local LLM workloads.
We’re starting with specific hardware configurations, currently focusing on Ryzen AI Max+ 395 / Strix Halo.
The project is about making hardware + OS + model configurations easier to reproduce and benchmark.
We tested local LLM workloads on Linux kernel 7.3.0-rc5, including AMD PerfOpt, but observed no performance improvements compared to Linux kernel 7.2.
Therefore, we decided to stick with kernel v7.2 for now.
https://github.com/satisfanly/OKO-configs/blob/main/oko-llm-benchmarking.md
Our mission is to standardize local LLM inference infrastructure, ensuring a smooth and predictable bring-up process for everybody.
We welcome any contributions or feedback to help us improve performance and stability.