1. Introduction
2. History and Overview about Artificial Neural Network
3. Single neural network
7. References
2. History and Overview about Artificial Neural Network
3. Single neural network
- 3.1 Perceptron
- 3.1.1 The Unit Step function
- 3.1.2 The Perceptron rules
- 3.1.3 The bias term
- 3.1.4 Implement Perceptron in Python
- 3.2 Adaptive Linear Neurons
- 3.2.1 Gradient Descent rule (Delta rule)
- 3.2.2 Learning rate in Gradient Descent
- 3.2.3 Implement Adaline in Python to classify Iris data
- 3.2.4 Learning via types of Gradient Descent
- 3.3 Problems with Perceptron (AI Winter)
- 4.1 Overview about Multi-layer Neural Network
- 4.2 Forward Propagation
- 4.3 Cost function
- 4.4 Backpropagation
- 4.5 Implement simple Multi-layer Neural Network to solve the problem of Perceptron
- 4.6 Some optional techniques for Multi-layer Neural Network Optimization
- 4.7 Multi-layer Neural Network for binary/multi classification
- 5.1 Overview about MNIST data
- 5.2 Implement Multi-layer Neural Network
- 5.3 Debugging Neural Network with Gradient Descent Checking
7. References
Implement Perceptron in Python
We went through many stuffs about Perceptron. Hope it clear to you, if it's quite subtle for you, don't worried, we're going to implement all of this materials in Python and if you have time, just play with some codes for yourself to get better intuition. In this exercise, we're going to use Perceptron to solve the arbitrary input and output, saysFirstly, we need to initialize the input matrix X and the target label y
Then, we also need to install Perceptron before learning the data Alright, we installed the Perceptron, let’s use it to learn the above data,
And the error curve,
After 50 epochs, the errors decrease to 0 and we have correctly desired output with the updated weight. So, we did about Perceptron, we'll go to another Single Neural Network is Adaline (ADAptive LInear NEuron) is considered to be interesting because it proposes some concepts about define and minimize the cost function that using in a lot of advanced machine learning algorithm afterward.
No comments :
Post a Comment
Leave a Comment...