“Autoencoders and rotten bananas” is the first story trying to teach you something new about machine learning.
A lot of work to get this out, and I hope you enjoy it as much as I did writing it.
digest.underfitted.io/archive/364757
A lot of work to get this out, and I hope you enjoy it as much as I did writing it.
digest.underfitted.io/archive/364757
This is such a great question!
Why in the world do we need autoencoders when we have pretty good compression algorithms?
Autoencoders will never do better than our existing techniques (like for example, JPEG encoding).
Why in the world do we need autoencoders when we have pretty good compression algorithms?
Autoencoders will never do better than our existing techniques (like for example, JPEG encoding).
https://twitter.com/HenryDouglas47/status/1370376327149187077?s=20
JPEG works for any image. Autoencoders only work for the type of images that it was trained on.
That's a big disadvantage.
But only if you are trying to use them to compress images.
Here is a killer application of autoencoders: anomaly detection.
That's a big disadvantage.
But only if you are trying to use them to compress images.
Here is a killer application of autoencoders: anomaly detection.
Imagine you train an autoencoder with a dataset of circuit boards that are correctly configured.
As soon as you give it an incorrect board, the autoencoder will have a hard time reproducing it, which will tell you there's a problem.
Just like the example of the rotten 🍌.
As soon as you give it an incorrect board, the autoencoder will have a hard time reproducing it, which will tell you there's a problem.
Just like the example of the rotten 🍌.
The idea is for the autoencoder to get really good at reproducing the original data. That's what "learning" means in this context.
An autoencoder is just a neural network, so yes, backpropagation happens here.
An autoencoder is just a neural network, so yes, backpropagation happens here.
https://twitter.com/HenryDouglas47/status/1370377929486561288?s=20
• • •
Missing some Tweet in this thread? You can try to
force a refresh
