What is WEB SCRAPING? 🤷‍♂️

To answer this question, I created a small web scraper for Amazon items.

This is a thread that explains step by step how it works 🧵👇

(find the complete code at the end) 1. What is web scraping?

A web scraper is a program that scans a website, and reads information from it, rather than using a public API.

2. Why would you use web scraping?

It can be used to retrieve data from a website when no public API is available.

(1/13)

If you're writing a Node app, you might have tasks you want to reoccur periodically. For example, run a cleaning task every Sunday night. Or check for updated weather conditions every day at 4 pm.

A quick walkthrough on how to do that 🧵 There are some ways to solve this.

You could for example use setInterval() to repeat every X seconds. (Please don't do this 🚫)

Or you could a piece of your app being called with the UNIX-native cron, which you need to set up in every machine you're running this on.

(1/8)

What is a senior developer *REALLY*?

There is a misconception in our industry that the senior developer title is earned by age or time in the company.

I disagree with that approach. Find out what I think a senior developer really is.

🧵👇 1. What a senior developer is NOT ☝️

👉 People that know everything about a programming language
👉 Know all the answers
👉 The absolute truth

(1/12)