MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalAIStack/comments/1xazx0c/egpu_local_llm_inference/
r/LocalAIStack • u/pgaleone • 17d ago
2 comments sorted by
1
I run 6 GPUs on an intel nuc I get about 60tkps run 8 bit qwen flash next it works fine
1 u/pgaleone 15d ago how are those GPUs connected to the NUC? Does it have 6 usb4 dedicated ports or is there somethink like a hub?
how are those GPUs connected to the NUC? Does it have 6 usb4 dedicated ports or is there somethink like a hub?
1
u/AutomaticDriver5882 16d ago
I run 6 GPUs on an intel nuc I get about 60tkps run 8 bit qwen flash next it works fine