I’m not saying you need to be an expert in advanced calculus to do machine learning…
BUT, there is a big difference between someone that does vs someone that does NOT have a good foundation in stats when it comes to getting & explaining business results.
My thought process back in the day was to obtain a great foundation in stats and machine learning at the same time.
So here’s what helped me. I read a ton of books.
Here are the 3 books that helped me learn data science the most...
1. R for Data Science (Wickham & Grolemund) r4ds.had.co.nz
1. Type 1 Error (False Positive): This occurs when the pregnancy test tells Tom, the man, that he is pregnant. Obviously, Tom cannot be pregnant, so this result is a false alarm. In statistical terms, it's detecting an effect (in this case, pregnancy) when it actually doesn't exist.
2. Type 2 Error (False Negative): This happens when Lisa, who is actually pregnant, takes the test, and it tells her that she's not pregnant. The test failed to detect the real condition of pregnancy. In statistical terms, it's failing to detect a real effect (pregnancy) that is there.
Why all data scientists should learn Polars in Python.
This is why: 🧵
The more I use Pandas, the more I become frustrated.
1. Pandas is slow.
The Polars API is between 3X and 3500X faster depending on the task. With large data, Polars is routinely 20X faster.
2. Pandas API is a mess. Things I hate that polars doesn't do:
- Index and multi-index.
- iloc vs loc vs at vs iat.
- Axis parameters (is 90% axis = 0 rows when I want 1 for columns)
- Inconsistent output: Sometimes I get a series, other times a data frame.
Forecasting time series is what made me stand out as a data scientist.
But it took me 1 year to master ARIMA.
In 1 minute, I'll teach you what took me 1 year.
Let's go. 🧵
1. ARIMA and SARIMA are both statistical models used for forecasting time series data, where the goal is to predict future points in the series.
2. Business Uses: I got my start with ARIMA using it for sales demand forecasting. But ARIMA and forecasting are also used heavily in econometrics, finance, retail, energy demand, and any situation where you need to know the future based on historical time series data.
Polars is a fast and efficient DataFrame library designed for data analysis and manipulation in Rust and Python.
It is built to provide high-performance data processing capabilities, often outperforming traditional libraries like pandas, especially with large datasets.
1. Performance: Polars is designed with performance in mind, leveraging Rust's speed and safety to handle large datasets efficiently.