Introduction
Complicated functions are hard to work with; polynomials are easy. Taylor polynomials approximate any smooth function near a point by a polynomial built from its derivatives. Gradient descent uses the first-order (linear) approximation; Newton's method uses the second-order (quadratic) one.