Theory of Intelligence
MATH FOR AI•Calculus•Multivariate Calculus•2.3 Jacobians

Introduction

Gradients of vector-valued functions, the Jacobian matrix, and the Jacobian determinant as a volume change.

Introduction

So far each function produced a single number. But a neural-network layer maps a vector to a vector, and a normalizing flow maps one distribution's samples to another's. The derivative of a vector-valued function is a matrix — the Jacobian — which is the best linear approximation of the function near a point.

Discuss theoretical concepts, mathematical formulas, and architectural foundations.

Supports inline code with `backticks`
No comments yet. Be the first to start the discussion!