Cheatography
https://cheatography.com
IntroAn Artificial Neural Network (ANN) is an information processing paradigm that is inspired by the way biological nervous systems, such as the brain, process information. | The key element of this paradigm is the novel structure of the information processing system. It is composed of a large number of highly interconnected processing elements (neurones) working in unison to solve specific problems. | ANNs, like people, learn by example. An ANN is configured for a specific application, such as pattern recognition or data classification, through a learning process. Learning in biological systems involves adjustments to the synaptic connections that exist between the neurones. This is true of ANNs as well. |
AdvantagesAdaptive learning: An ability to learn how to do tasks based on the data given for training or initial experience. | Self-Organisation: An ANN can create its own organisation or representation of the information it receives during learning time. | Real Time Operation: ANN computations may be carried out in parallel, and special hardware devices are being designed and manufactured which take advantage of this capability. |
| | Learning ProcessActivation Function | Each neuron has an activation function that defines the output of the neuron | The activation function is used to introduce non-linearity in the modeling capabilities of the network | | forwardpropagation | occurs when the network is exposed to the training data and these cross the entire neural network for their predictions (labels) to be calculated. | | loss function | to estimate the loss (or error) and to compare and measure how good/bad our prediction result was in relation to the correct result (remember that we are in a supervised learning environment and we have the label that tells us the expected value). Ideally, we want our cost to be zero | as the model is being trained, the weights of the interconnections of the neurons will gradually be adjusted until good predictions are obtained. | | backpropagation | Once the loss has been calculated, this information is propagated backwards. |
Learning process of one perceptron
|
Created By
Metadata
Comments
No comments yet. Add yours below!
Add a Comment
Related Cheat Sheets