One term that I learned when I started studying ML is Hyperparameter.
What is it?
When should I worry about it?
Let me try to clarify it...
[3 min]
1/9π§΅
What is it?
When should I worry about it?
Let me try to clarify it...
[3 min]
1/9π§΅
First, what are the parameters of a ML model?
Those are typically the weights that you end up with after training your model. Example:
If you are creating a model to solve
AX + B = Y
A and B are the parameters you'll find. They are also know as the weights of the model
2/9π§΅
Those are typically the weights that you end up with after training your model. Example:
If you are creating a model to solve
AX + B = Y
A and B are the parameters you'll find. They are also know as the weights of the model
2/9π§΅
Hyperparameters are the values that control the learning process.
Let's suppose we have the code in the image.
Hyperparameters could be: unit (from the Dense layer), learning_rate from the optimizer or even the batch_size
3/9π§΅
Let's suppose we have the code in the image.
Hyperparameters could be: unit (from the Dense layer), learning_rate from the optimizer or even the batch_size
3/9π§΅
The next question is: how do I choose the best Hyperparameters for my model?
This is where it gets tricky! This is a process of experimentation even if you are very experienced!
You could manually try multiple different and compare the models metrics by hand, or...
4/9π§΅
This is where it gets tricky! This is a process of experimentation even if you are very experienced!
You could manually try multiple different and compare the models metrics by hand, or...
4/9π§΅
Keras Tuner is a library that can help you experiment with hyperparameters for your TF model!
You define a set of variables to try and their ranges and the library will execute multiple training steps and automatically search for the best values for the hyperparameters
6/9π§΅
You define a set of variables to try and their ranges and the library will execute multiple training steps and automatically search for the best values for the hyperparameters
6/9π§΅
You can learn more about it on this notebook: tensorflow.org/tutorials/keraβ¦
It will show you how to use a basic setup for an image recognition model.
I highly recommend trying it out, you'll get a much deeper understanding!
7/9π§΅
It will show you how to use a basic setup for an image recognition model.
I highly recommend trying it out, you'll get a much deeper understanding!
7/9π§΅
The values of the parameters used during the tuning process can also be visualized on TensorBoard for an even better understanding of the process
You can try it here: tensorflow.org/tensorboard/hyβ¦
8/9π§΅
You can try it here: tensorflow.org/tensorboard/hyβ¦
8/9π§΅
Hyperparameter tuning is an important part of creating the best ML models.
Understanding how to do it in a reproducible way is a key part of it and Keras Tuner is here to help you.
Do you use any other tools for this task?
9/9π§΅
Understanding how to do it in a reproducible way is a key part of it and Keras Tuner is here to help you.
Do you use any other tools for this task?
9/9π§΅
β’ β’ β’
Missing some Tweet in this thread? You can try to
force a refresh
γ
