In the document, we present:
- Each neural network (NN) consists of many neurons, and each neuron has two elements: linear function and activation function.
- We have shown the reason of using activation functions. (choices of activation functions)
- Two numerical examples have been given to track the forward and backward propagation of a neuron.
- We also implemented the NN to do binary classification task, and showed the experimental results.