Introduction
Bernoulli, Binomial, Categorical, Poisson, Gaussian, Beta, Gamma… it looks like a zoo. In fact almost all of them share one template: the exponential family. Knowing this template explains why they all have conjugate priors, why maximum likelihood for them only needs a few summary numbers, and why generalised linear models (logistic and Poisson regression) look the way they do.