| Milestone/contribution | Contributor, year |
| MCP model, regarded as the ancestor of the Artificial Neural Network | McCulloch & Pitts, 1943 | Hebbian learning rule | Hebb, 1949 | First perceptron | Rosenblatt, 1958 | Backpropagation | Werbos, 1974 | Neocognitron, regarded as the ancestor of the Convolutional Neural Network | Fukushima, 1980 | Boltzmann Machine | Ackley, Hinton & Sejnowski, 1985 | Restricted Boltzmann Machine (initially known as Harmonium) | Smolensky, 1986 | Recurrent Neural Network | Jordan, 1986 | Autoencoders | Rumelhart, Hinton & Williams, 1986 | Ballard, 1987 | LeNet, starting the era of Convolutional Neural Networks | LeCun, 1990 | LSTM | Hochreiter & Schmidhuber, 1997 | Deep Belief Network, ushering the “age of deep learning” | Hinton, 2006 | Deep Boltzmann Machine | Salakhutdinov & Hinton, 2009 | AlexNet, starting the age of CNN used for ImageNet classification | Krizhevsky, Sutskever, & Hinton, 2012 |
|
|