Theory of Intelligence
MACHINE LEARNING•Classic Algorithms•Decision Trees•2.3 The CART Algorithm

Introduction

How scikit-learn grows a tree: greedily searching for the split that best reduces impurity, and what that costs in computation.

Introduction

How does a tree decide which question to ask first, and where to put the threshold? scikit-learn uses an algorithm called CART (Classification And Regression Tree). Its strategy is simple and practical: at each step, try every possible question and keep the one that best separates the classes — then repeat for each half.

It's like organising a messy cupboard: first split everything into "kitchen" and "not kitchen" (the most useful single split), then split each pile again, and so on, without going back to reconsider the first split.

Discuss theoretical concepts, mathematical formulas, and architectural foundations.

Supports inline code with `backticks`
No comments yet. Be the first to start the discussion!