Theory of Intelligence
MACHINE LEARNING•Unsupervised Learning•Dimensionality Reduction•1.1 The Curse of Dimensionality

Introduction

Why spaces with many features behave strangely — data become sparse and distances lose meaning — and what that means for machine learning.

Introduction

Many real datasets have lots of features: a 28 × 28 image has 784, a customer profile might have 500, a gene-expression sample 20,000. Each feature is a dimension. We're used to thinking in 2 or 3 dimensions, but high-dimensional spaces behave in ways that defy intuition — and these surprises cause real problems for ML. Together they're called the curse of dimensionality.

The good news: the next topics show how to reduce the number of dimensions while keeping most of the information, which speeds up training, helps visualisation, and sometimes improves accuracy.

Discuss theoretical concepts, mathematical formulas, and architectural foundations.

Supports inline code with `backticks`
No comments yet. Be the first to start the discussion!