Machine Learning Fundamentals · Model evaluation

Bias-variance tradeoff

A model too simple has high bias (underfits); one too flexible has high variance (overfits), and you can't minimize both at once.

Also known as: bias variance decomposition.

Start a lesson on Bias-variance tradeoff

Learn first

• Linear regression: Fitting a straight line (or hyperplane) through data to predict a continuous number.

Leads to

• Overfitting and underfitting: A model that memorizes training data instead of learning the pattern (overfit), or one too weak to learn it at all (underfit).

Related topics

• Overfitting and underfitting: A model that memorizes training data instead of learning the pattern (overfit), or one too weak to learn it at all (underfit).