Santiago Profile picture
18 Mar, 13 tweets, 5 min read
I can't shut up about neural networks.

What questions do you have?
They aren't necessarily opposite concepts.

Fully connected refer to networks composed of layers where every node is connected to every node of the next layer.

Deep networks refer to networks with many layers. They could be fully connected or not.

Especially with deep learning, where you have many layers full of nodes, it's hard to understand the "thinking" of a network because you'll have to reverse-engineer million of float values and try to make sense of them.

Hard to do.

Forward pass: you compute the value of every node using the current weights.

Backward propagation: You move backward through the network, re-computing the weights' value to optimize the loss of the network.

That's the way the network "learns."

You can learn about neural networks right now with very little previous knowledge.

I'd suggest you watch @3blue1brown's videos about Neural Networks for an excellent introduction.

Backpropagation is about updating the weights to optimize our loss.

To optimize our loss we need to understand what the actual label is.

You experiment.

Experience gives you an idea of boundaries (why would 2,056 is stupidly large and 2 stupidly short,) but good performance comes out of a lot of experimentation.

Watch @3blue1brown YouTube series on neural networks for an amazing introduction.

First, go through the Kaggle tutorials. Then, start with the Titanic competition.

Start with Adam.

Switch when you have a good reason to do it.

The ones that are used to solve real problems that affect humanity.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Santiago

Santiago Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @svpino

19 Mar
Thoughts about starting with machine learning.

☕️🧵👇
Three unnegotiable prerequisites:

1. Software development
2. Algorithms and data structures
3. Communication

If you build a strong foundation on these, you'll be unstoppable.
Learn to build software.

It's hard to make progress with machine learning if you struggle with programming.
Read 23 tweets
18 Mar
The ability to reuse the knowledge of one model and adapt it to solve a different problem is one of the most consequential breakthroughs in machine learning.

Grab your ☕️ and let's talk about this.

🧵👇
A deep learning model is like a Lego set, with many pieces connected, forming a long structure.

These pieces are layers, and each layer has a responsibility.
Although we don't know exactly the role of every layer, we know that the closer they get to the output, the more specific they get.

The best way to understand what I mean is through an example: a model that will process car images.
Read 13 tweets
17 Mar
Here are some of the features that make Python 🐍 a freaking cool language.

🧵👇
1. You can slice and dice arrays very easily.
2. What's even better: negative indexing is really cool, and you can use it to refer to items from the last element in the list.
Read 15 tweets
16 Mar
5 Python 🐍 package managers that I'm not using anymore:

▫️ conda
▫️ virtualenv
▫️ venv
▫️ pipenv
▫️ poetry

🤷‍♂️

Instead, for several weeks now, I've been using development containers in Visual Studio Code.

Life-changing. Give 'em a try.
Here is a thread I wrote a few weeks back when I started using them:
An important note: here I’m referring to the “virtual environment” capabilities of these tools. I still need to pip modules down.

But I’ve been isolating environments with the containers instead.
Read 5 tweets
15 Mar
You aren't doing yourself any favors if you aren't throwing away your validation data regularly.

It's painful, I know, but you are looking for trouble if you don't do it.

Let's talk about what happens with your data and your model.

Grab the ☕️, and let's do this thing. 🧵👇
Every machine learning tutorial teaches you about splitting your dataset.

They either go with train/test or train/validation/test. Nomenclature doesn't matter here. You just need to understand how each one of these is used.

Here is a thread about this:

Let's think of a neural network and focus on the train set for a second.

We use this to train our model. The data on this set is the one the network uses to adjust the weights.

And, of course, the model will get really good at solving this set.
Read 8 tweets
15 Mar
My recommendation to learn machine learning:

▫️ Machine Learning Crash Course (Google)
▫️ Machine Learning (Coursera)

Take them in order. They are both free. They are both amazing.

(Before you embark on this journey, make sure you feel comfortable writing Python 🐍.)
Not really. Nothing has changed with the fundamentals. The course is as relevant today as it was back in 2010.
Experience will help you make a few sensible choices that you can later test.
Read 8 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!