From the Perceptron to Artificial Neural Networks

The spectacular success of today’s artificial neural network applications has its roots in many small advances combined with a number of pivotal ideas. This chapter starts with introducing the biological neuron, which has been the motivation for creating computational models of increasing complexity. By following the historical developments of early computational models, we explain the steps leading toward modern artificial neural networks and deep learning techniques.