Thread by @simonw

I presented a 90 minute workshop on Git scraping and how to explore the resulting data using @datasetteproj at #CodaBr21 (by @EscolaDeDados) today

Here are the exercises from the workshop, plus additional screenshots and notes that I added afterwards

docs.google.com/document/d/1TC…

@datasetteproj @EscolaDeDados To save attendees from having to get a working Python environment setup on their laptop, I instead encouraged them to use a free @gitpod account (gitpod.io) - I demonstrated each exercise in GitPod too

Cloud-based development environments are SO GOOD for tutorials

(I had planned to use GitHub Codespaces for this, but then realized that those are not freely available to non-paid users outside of the beta program yet)

I built a brand new CLI tool for the workshop: git-history, which takes a JSON or CSV file that's been scraped to a Git repository (and has a long and interesting revision history) and turns it into a SQLite database so you can query the multiple versions datasette.io/tools/git-hist…

More on that tool later, once I get a chance to write it up for my blog

The workshop included a shout out to the LA Times @datagraphics team who have absolutely incredible open source scrapers running in GitHub Actions - you can learn so much from browsing their code in github.com/datadesk/calif…