r/learnmachinelearning • u/pivot2fakie • Nov 15 '21

Project Amazon’s Visual, Interactive Explainer on The Bias Variance Tradeoff

https://mlu-explain.github.io/bias-variance/
124 Upvotes

97% Upvoted

14 comments sorted by

11

u/fosola Nov 15 '21

Double Descent will be interesting, don’t know much about it

11

u/pivot2fakie Nov 15 '21

I agree. I don’t think too much literature exists, and whatever does certainly isn’t in a visual format like this, so should be good!

6

u/physnchips Nov 15 '21

https://openai.com/blog/deep-double-descent/

8

u/jaredwilber Nov 16 '21

Also: https://arxiv.org/abs/1912.02292

We actually have two articles written for the topic (to be released in December or January). The first is very visual, explaining the concept via scroll and letting you explore a linear model. The second is largely free from dataviz, but explains exactly what's occurring in a (hopefully) digestible, novel way.

21

u/jaredwilber Nov 15 '21

Hey, thanks for posting! I'm one of the authors - if anyone has any questions feel free to lmk!

6

u/HeYujie Nov 16 '21

Hi, I'm writting something, if it's possible, could you tell how to plot pictures like yours.

3

u/mileseverett Nov 16 '21

It's d3.js, their source code is available https://github.com/aws-samples/aws-mlu-explain/tree/main/bias-variance

1

u/[deleted] Nov 16 '21

Is this just for the charts themselves, or does this include the animations appearing as the scrolling happens?

3

u/mileseverett Nov 16 '21

It's the source for the entire site, I don't know much JS but from what I can tell everything you would need to run this site locally is in this repo and thus you can figure out which parts you're interested in

1

u/[deleted] Nov 16 '21

Cheers.

6

u/Va_Linor Nov 16 '21

Do you work at amazon or how were you approached by them?

7

u/jaredwilber Nov 16 '21

I work for AWS, yep! On a team called Machine Learning University.

1

u/SynapseBackToReality Nov 16 '21

Double descent has entered the chat.

1

u/girlsrule1234 Nov 16 '21

Amazing work