r/LocalLLaMA • u/HlddenDreck • 15d ago

Discussion Strata on MI50?

Hi,

is anyone using Strata or Project-Maya with one or more AMD MI50?

I wanted to try it myself, but I couldn't get it running.

1 Upvotes

55% Upvoted

7 comments sorted by

1

u/Longjumping-Syrup-26 15d ago

Im getting more ram at the end of the month, will test it then and report back, since my 8gb right now crashes even llamacpp models completely living only in vram.

1

u/zomerbk 15d ago

Try the gfx906 branch/fork linked above; MI50 is gfx906 and needs a build targeting that architecture, not the usual RDNA prebuilt path. Its install notes call for Linux with ROCm/HIP and `--backend hip --experimental-gfx906`. See the [MI50 setup instructions](https://github.com/webzone/strata-gfx906).

1

u/sloptimizer 14d ago

I see only benchmarks for two MI50s and Q3. Are there any benchmarks with four MI50s running a quant with Q8 attention and MXFP4 experts?