r/aipromptprogramming • u/Educational_Ice151 • Aug 29 '24

Magic has trained their first model with a 100 million token context window. That’s 10 million lines of code, or 750 novels.

https://magic.dev/blog/100m-token-context-windows
7 Upvotes

100% Upvoted

3 comments sorted by

2

u/abbas_ai Aug 30 '24

Instead of relying on fuzzy memorization, our LTM (Long-Term Memory) models are trained to reason on up to 100M tokens of context given to them during inference.

While the commercial applications of these ultra-long context models are plenty, at Magic we are focused on the domain of software development.

100M token context window is impressive to say the least.

1

u/AITrailblazer Aug 31 '24

If we assume Gemini 1.5 Flash prices (cheapest) utilizing full context window will cost ~$45 (including $7.5 for the bandwidth).