I am using @weights_biases from past 4-5 months and I am in love with the product. It makes working with Deep Learning projects super easy, trackable and fun. Here are some of my favourite features of wandb 👇
1. It is super easy to integrate Weights and Biases with any framework of your choice
2. You can literally log anything to wandb from any metrics you want to track, to model's weights, data, images, configurations, etc. Basically anything you can think of
3. You can even monitor your model's gradients by using their watch function to inspect any bugs in your model (gradient explosion, etc)
4. You can set name to your experiments and group them accordingly in your dashboard to see the performance selectively.
5. Weights and biases also provide a cool table where you can check all your logged information, apply filters to it, sort according to fields, and also export the table as CSV for further inspection.
6. They also provide data and model versioning (same as you version code in Git)
7. Wandb sweep allows you to automate hyperparameter optimization
8. It is super easy to work in teams on wandb with features like collaborative reports
9. You can even send alerts about your training progress to your email or slack channel (for ex: run is finished, accuracy increased in 2nd epoch, etc)
So you don't have to always watch the model training.
10. This is kind of a Easter egg feature: you can turn on dark mode on your profile by writing 'night' in your profile's description
11. They have some amazing blogs, and are doing great community work on their YouTube channel. I am in love with Weights and Biases.
They have many more amazing features.
Check out their website to know more about them👇
So, recently there was this question from @svpino that in theory, you can model any function using a neural network with a single hidden layer. However, deep networks are much more efficient than shallow ones. Why?
Here's a thread answering that question🧵
📌 Both shallow (network with one hidden layer) and deep networks(network with multiple hidden layers) are capable of approximating any function (theoretically). But, still, you get better results with deep neural networks. Here's why 👇
1. To match the performance of a multi-layered neural network you would require a large number of neurons in a single layer in the case of shallow networks.
Some of the best resources I came across for intuitively visualizing #NeuralNetworks (how they transform data and classify stuff).
With these resources, Neural Networks will be no longer black boxes for you'll.
A thread 🧵
A playlist by none other than @3blue1brown explaining how forward and backward propagation works with great visualizations as always. You can't miss this ... youtube.com/playlist?list=…
A great article from @ch402 explaining how a neural net transforms the data. He has some other great blogposts too, do check out the complete website colah.github.io/posts/2014-03-…
What is sampling in #MachineLearning and what are different sampling techniques?
Detailed analysis of 10 widely used sampling techniques. (Notes at the end 👇)
A thread 🧵
PS: There is a Notion document at the end of the thread with detailed notes on this topic 😎
Population vs Sample ✨
📌 Population - Population is the collection of the elements which has some or the other characteristic in common.
📌 Sample - Sample is the subset of the population. The process of selecting a sample is known as sampling
Why do we even need sampling 🤔?
📌 Dealing with a complete population is very hard (almost impossible). Sampling is a method that allows us to get information about the population without investigating every individual.
How to learn a Machine Learning algorithm?
Everything you need to consider while approaching to learn a #MachineLearning algorithm 👇
A thread 🧵
1. Get the intuition behind the algorithm (i.e its core ideas and why the algorithm is there in the first place).
--- 2. Get the mathematical intuition behind the algorithm (understand the math working under the hood).
---
3. For what the algorithm is used (regression/classification/both) and how it is modified to fit different scenarios.
--- 4. How the algorithm works with numerical and categorical data?
---