dev-resources.site
for different kinds of informations.
Deep Neural Network (DNN) in a Brief
Published at
2/7/2021
Categories
machinelearning
deeplearning
architecture
datascience
Author
Afroz Chakure
Neural Network (NN):
It is a series of algorithms that endeavors to recognize underlying relationships in a set of data through a process that mimics the way the human brain operates.
Examples and Applications of NN:
- Convolutional neural network => Good for image recognition
- Long Short-Term memory network => Good for Speech Recognition
Neuron:
- It is a mathematical function that models the functioning of a biological neuron.
- It computes the weighted average of its input and passes the sum through a non-linear function called the activation function (such as the sigmoid).
Training an Artificial neural network:
Gradient Descent:
- The process of repeated nudging an input of a function by some multiple of the negative gradient is called Gradient Descent.
- When there are one or more inputs, you can use Gradient descent for optimizing the values of the coefficients by iteratively minimizing the error of the model on your training data.
- A learning rate is used as a scale factor and the coefficients are updated in the direction towards minimizing the error.
- This process is repeated until a minimum sum squared error is achieved or no further improvement is possible.
Backward Propagation:
- It is an algorithm for supervised learning of an ANN using Gradient Descent.
- Given an ANN and an error function it calculates the gradient of the error function w.r.t. the NN weights.
- Here the partial computations of the gradient from one layer are reused in the computation of the gradient for the previous layer.
Backpropagation Calculation:
- The chain rule expressions give us the derivatives that determine each component in the gradient that helps to minimize the cost of the network by repeatedly stepping downhill.
Articles
12 articles in total
Yay! Reached 1035+ days Daily Coding Streak on Leetcode!
read article
52 Tricks to Media Manipulation
read article
Solved 1000+ Problems on Leetcode, Yay!
read article
Argh! Lost my 649 Days Hot streak on Leetcode
read article
365 days and counting
read article
Ouch! Just lost my streak on Leetcode
read article
Completed 500 problems on Leetcode!
read article
Yo! I completed 100 days of Leetcode
read article
All you need to know about YOLO v3 (You Only Look Once)
read article
Transfer Learning with MobileNet-v2
read article
Hyper-Parameter Tuning to Optimize ML Models (MobileNet v2)
read article
Deep Neural Network (DNN) in a Brief
currently reading
Featured ones: