Introduction
Using the limit definition every time would be painful. A handful of rules let us differentiate almost any formula mechanically. The most important of them, the chain rule, is the entire mathematical basis of backpropagation.
Power and constant rules, sum and product rules, the quotient rule, the chain rule, and derivatives of exp, log and the sigmoid.
Using the limit definition every time would be painful. A handful of rules let us differentiate almost any formula mechanically. The most important of them, the chain rule, is the entire mathematical basis of backpropagation.
Discuss theoretical concepts, mathematical formulas, and architectural foundations.