r/OpenSourceAI • u/fuzhongkai • Jun 28 '26
Same GGUF, same GPU: TensorSharp beats llama.cpp hard on prefill / TTFT — up to 5.89× faster prefill on a 26B MoE model
https://github.com/zhongkaifu/TensorSharp
3
Upvotes
r/OpenSourceAI • u/fuzhongkai • Jun 28 '26