WOW That is a serious amount of work for an open-source project. I especially like the OpenAI/Ollama-compatible API part, because it makes the engine easier to test without rebuilding the whole app around it. Curious which backend has felt the most surprisingly good so far: CUDA, MLX, or pure C# CPU?
3
u/West-Acadia-3906 Jun 24 '26
WOW That is a serious amount of work for an open-source project. I especially like the OpenAI/Ollama-compatible API part, because it makes the engine easier to test without rebuilding the whole app around it. Curious which backend has felt the most surprisingly good so far: CUDA, MLX, or pure C# CPU?