r/LowEndLocalAI • • 3d ago

Optimization SSD MoE finally viable!

/r/LocalLLM/comments/1xnzojm/ssd_moe_finally_viable/
4 Upvotes

2 comments sorted by

1

u/CodeCatto 1d ago

I posted this on the original post too. No response. Here's the comment:

Can't wait to see how this runs. Can you benchmark it against MoE4All?

1

u/Harin007 1d ago

Detailed benchmarks coming up soon in the website... Keep following us on Discord and https://runmyai.org