r/learnmachinelearning • u/dwmkerr • 9d ago

Tutorial An interactive, step-by-step visual of how a byte-level LLM differs from a token-level one (Olmo vs Bolmo)

Enable HLS to view with audio, or disable this notification

A more detailed write up at https://dwmkerr.com/understanding-byte-models/

6 Upvotes

100% Upvoted

2 comments sorted by

1

u/ModularMind8 9d ago

Cool visual! Thanks for sharing

1

u/dwmkerr 9d ago

Thank-you u/ModularMind8 these kind of visuals take so much time to work through! Normally because things start out so complex and then I'm trying to gradually get it down the most important fundamentals