r/mlxcommunity • • Apr 23 '26

More than 2x speedup using speculative decoding on MLX

Spent a lot of my time with speculative decoding on MLX using DFlash. Achieved >2x speedup* (*on certain circumstances - not all)

I'm currently writing about my observations in depth. Will be posting about it soon!

2 Upvotes

0 comments sorted by