Theory of Intelligence
DEEP LEARNING•Neural Networks•From Biological To Artificial Neurons•1.3 Logic with Neurons & the XOR Problem

Introduction

Build AND, OR and NOT gates from single neurons, see why XOR is impossible for one neuron, and solve it by adding a hidden layer.

Introduction

Computers are built from tiny logic gates — AND, OR, NOT — combined in huge numbers. In 1943, McCulloch and Pitts showed that simple artificial neurons can act as these gates. That was a big idea: if neurons can do logic, then networks of neurons can, in principle, compute anything a computer can.

But one innocent-looking gate, XOR ("exclusive or"), can't be built from a single neuron. Understanding why — and how a second layer fixes it — is the clearest way to see why neural networks need hidden layers.

Discuss theoretical concepts, mathematical formulas, and architectural foundations.

Supports inline code with `backticks`
No comments yet. Be the first to start the discussion!