Day 8 of #31DaysofML
π Learning Rate π Also known as Step size
It's a scalar that is multiplied with gradient vector (which has the direction & magnitude) to provide the next value on the loss curve
A π§΅
π Learning Rate π Also known as Step size
It's a scalar that is multiplied with gradient vector (which has the direction & magnitude) to provide the next value on the loss curve
A π§΅
π Smaller the learning rate the longer it will take to find the lowest loss value
π Large learning rate could overshoot the minimum
π You the learning rate to be just right (Goldilock's learning rate) to get the convergence value efficiently
#31DaysofML 2/3
π Large learning rate could overshoot the minimum
π You the learning rate to be just right (Goldilock's learning rate) to get the convergence value efficiently
#31DaysofML 2/3
Learning rate is one of the "Hyperparameters" that we tweak in machine learning algorithms. This is to tune the learning rate to efficiently get to the lowest loss value. There are more hyperparameters which we will get to later...
#31DaysofML 3/3
#31DaysofML 3/3
β’ β’ β’
Missing some Tweet in this thread? You can try to
force a refresh
γ
