1. Introduction
2. History and Overview about Artificial Neural Network
3. Single neural network
7. References
2. History and Overview about Artificial Neural Network
3. Single neural network
- 3.1 Perceptron
- 3.1.1 The Unit Step function
- 3.1.2 The Perceptron rules
- 3.1.3 The bias term
- 3.1.4 Implement Perceptron in Python
- 3.2 Adaptive Linear Neurons
- 3.2.1 Gradient Descent rule (Delta rule)
- 3.2.2 Learning rate in Gradient Descent
- 3.2.3 Implement Adaline in Python to classify Iris data
- 3.2.4 Learning via types of Gradient Descent
- 3.3 Problems with Perceptron (AI Winter)
- 4.1 Overview about Multi-layer Neural Network
- 4.2 Forward Propagation
- 4.3 Cost function
- 4.4 Backpropagation
- 4.5 Implement simple Multi-layer Neural Network to solve the problem of Perceptron
- 4.5.1 Visualize the problem of Perceptron
- 4.5.2 Solve the problem using Multi-layer Neural Network
- 4.6 Some optional techniques for Multi-layer Neural Network Optimization
- 4.7 Multi-layer Neural Network for binary/multi classification
- 5.1 Overview about MNIST data
- 5.2 Implement Multi-layer Neural Network
- 5.3 Debugging Neural Network with Gradient Descent Checking
7. References
Visualize the problem of Perceptron
In this exercise, we reuse the Iris flower data set, but now, we adjust dataset a little bit to have non-linear data instead of linear data in the section \(3.2\) where Perceptron could solve it. Alright, let's prepare some non-linear data set now.### Load some needed libraries ### Adjust Iris data a little bit and visualize the result ### Here are the result we obtained
### Now let’s use Perpceptron model we installed before to classify this data to see what happen, some codes to show the error of Perceptron on this data
### As we can see, the error of Perceptron is a flat line after 2000 epochs and never decrease, you can check this for yourself. Now let’s plot the Decision boundary of Perceptron, ### Here are the graph we obtained
Look at the Decision Boundary of Perceptron, it seems our model is fitting poorly with the data, right? In fact, Perceptron can not fit the non-linear data and why it can not we've already discussed in the previous section. So, let's use Multi-layer Neural Network to solve it.
No comments :
Post a Comment
Leave a Comment...