Theory of Intelligence
MATH FOR AI•Calculus•Differentiation Basics•1.1 Limits & the Difference Quotient

Introduction

Slopes of secant lines, the idea of a limit, and the definition of the derivative.

Introduction

Training a model means changing its parameters so the loss goes down. To know which way is down, we need the rate of change of the loss — its derivative. This topic builds the derivative from scratch: start with the slope between two points, then let the points move together.

Discuss theoretical concepts, mathematical formulas, and architectural foundations.

Supports inline code with `backticks`
No comments yet. Be the first to start the discussion!