Share this page!

Enter URL or ID to Unroll

You can paste full URL like: https://x.com/threadreaderapp/status/1644127596119195649
or just the ID like: 1644127596119195649

How to get URL link on X (Twitter) App

  1. On the Twitter thread, click on or icon on the bottom
  2. Click again on or Share Via icon
  3. Click on Copy Link to Tweet
  4. Paste it above and click "Unroll Thread"!
  5. More info at Twitter Help
Matt Dancho (Business Science) Profile picture
@mdancho84
May 20, 2023 • 7 tweets • 5 min read • Read on X
Scrolly
As a data scientist, productivity is a 10X super power.

Here's a short list of AI tools to help data scientists with: 🧵

#ai #datascience #career #skills #tools Image
1. Writing code

AI pair programming is a huge benefit.

Tools like #chatgpt & github #copilot can help debug complex code and replace Googling + Stack Overflowing for common scripting.

Key skill: ChatGPT prompting (more on this in my free ChatGPT for Data Scientists) Image
2. Code Quality & Documentation

Great products have great documentation. AI can help produce documentation, comment code, and replace time-consuming manual documentation with automated AI docs.

Key Skill: Using @mintlify to build your docs: mintlify.com Image
3. Presentations

Great data scientists are storytellers. Use persuasion to your advantage.

Key Skill: Generating images with AI using @midjourney_ai . midjourney.com Image
I'm road-testing all of these.

And I've been quietly researching #ChatGPT for Data Scientists (My NUMBER 1 TOOL) for the past 4 months.

I have good news - I'm ready to reveal my chatgpt research!
If you want to understand how ChatGPT can make you a better data scientist (and mistakes to avoid)...

I'll be sharing my research in a Free WORKSHOP: ChatGPT for Data Scientists (Wednesday, June 7th)!
What's Your Next Step?

Join me and 1,000 data scientists as we crush AI in my LIVE ChatGPT for Data Scientists Workshop.

Seats are limited (1,000 max).

👉Register Here: us02web.zoom.us/webinar/regist… Image

• • •

Missing some Tweet in this thread? You can try to force a refresh
　

Keep Current with Matt Dancho (Business Science)

Matt Dancho (Business Science) Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @mdancho84

Matt Dancho (Business Science) Profile picture
Apr 22
Understanding regression models is essential in data science.

In 4 minutes, I'll demolish your confusion. Let's go: Image
1. The 6 Diagnostic Checks Every Data Scientist Should Run

Once you've built a regression model, your job isn't done. These 6 checks will tell you whether your model can actually be trusted.
2. Posterior Predictive Check

Ask yourself: do the model-predicted lines resemble the observed data line? If your model is a good fit, simulated data from it should look similar to your actual data. When they diverge wildly, your model is missing something important. Image
Read 9 tweets
Matt Dancho (Business Science) Profile picture
Apr 19
Understanding probability is essential in data science.

In 4 minutes, I'll demolish your confusion.

Let's go! Image
1. Statistical Distributions:

There are 100s of distributions to choose from when modeling data. Choices seem endless. Use this as a guide to simplify the choice. Image
2. Discrete Distributions:

Discrete distributions are used when the data can take on only specific, distinct values. These values are often integers, like the number of sales calls made or the number of customers that converted.
Read 10 tweets
Matt Dancho (Business Science) Profile picture
Apr 18
RIP manual research workflows.

Someone just open-sourced what comes after Karpathy’s AutoResearch.

It’s called AutoResearchClaw.

And this thing is insane. Image
A few weeks ago, Karpathy showed where research was heading:

AI agents running the experiment loop.

That was already a big signal.

AutoResearchClaw takes it even further.

It doesn’t just help with research.

It tries to automate the entire scientific method end-to-end.
You give it a raw idea.

One CLI command.

Then it runs.

Not just “brainstorming.”

Not just “summarizing.”

Actually running the workflow.
Read 8 tweets
Matt Dancho (Business Science) Profile picture
Apr 15
These 7 statistical analysis concepts have helped me as an AI Data Scientist.

Let's go: 🧵 Image
Step 1: Learn These Descriptive Statistics

Mean, median, mode, variance, standard deviation. Used to summarize data and spot variability. These are key for any data scientist to understand what’s in front of them in their data sets. Image
2. Learn Probability

Know your distributions (Normal, Binomial) & Bayes’ Theorem. The backbone of modeling and reasoning under uncertainty. Central Limit Theorem is a must too. Image
Read 9 tweets
Matt Dancho (Business Science) Profile picture
Apr 7
🚨 BREAKING: Microsoft launches a free Python library that converts ANY document to Markdown

Introducing Markitdown. Let me explain. 🧵 Image
1. Document Parsing Pipelines

MarkItDown is a lightweight Python utility for converting various files to Markdown for use with LLMs and related text analysis pipelines. Image
2. Supported Documents

MarkItDown supports:

- PDF
- PowerPoint
- Word
- Excel
- Images (EXIF metadata and OCR)
- Audio (EXIF metadata and speech transcription)
- HTML
- Text-based formats (CSV, JSON, XML)
- ZIP files (iterates over contents)
- Youtube URLs
- EPubs Image
Read 7 tweets
Matt Dancho (Business Science) Profile picture
Apr 2
RIP document extractors.

Google just released LangExtract: Open-source. Free. Better than $100K enterprise tools.

Here’s what it does: 🧵 Image
What it does:

→ Extracts structured data from messy text
→ Grounds every field to the exact source location
→ Handles 100+ page docs
→ Generates interactive HTML for verification
→ Works with Gemini + local models Image
What it replaces:

→ Regex/fragile parsing
→ Custom NER pipelines
→ Expensive extraction APIs
→ Manual data entry Image
Read 8 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

Send Email!

:(