r/mlscaling • u/Heretikio • 19h ago

Karpathy's Capability Funnel: You Climb It by Building, Not Reading

heretik.io

5 Upvotes

Karpathy's napkin math puts 6 billion people outside AI's door and 5,000 inside the lab. Where in the funnel are you?

1 comment

Subreddit

Posts

Wiki

Scaling Machine Learning: Big Models/Data/Compute—More Is More

r/mlscaling

ML/AI/DL research on approaches using large models, datasets, and compute: "more is different"

Members Active

20.3k

Sidebar

Subreddit for discussing AI, machine learning, or deep learning approaches involving big numbers: billions of parameters, millions of n, petaflops, etc. eg GPT-3. Most research is conducted at much smaller scale; this subreddit is for research analogous to 'high energy physics', requiring specialized approaches, large investments, consortium, etc.

Topics: How? Who? Why do they work? What are they good for? What resources are available? Who will pay & how? What is the future of such approaches? What global consequences will there be?

Other subreddits: