Share this page!

Simon Willison Profile picture
Twitter logo
13 Nov, 5 tweets, 2 min read
Datasette is four years old today! It's come a long way since that first release back in 2017 simonwillison.net/2017/Nov/13/da…
Progress on the project is pretty thoroughly documented by the datasette tag on my blog - 249 items and counting simonwillison.net/tags/datasette/
Something that really excites me about Datasette is that I can genuinely see myself still being thrilled to work on it ten years from now.

Projects like that are pretty rare - I feel very lucky to have found one that combines so many of my interests all in one package
99 releases without hitting 1.0 isn't something I'm proud of though, maybe my birthday gift to the project should be a genuine commitment to getting that milestone out of the way docs.datasette.io/en/stable/chan…
Decided to celebrate Datasette's four year birthday with a 0.59.2 bug fix release docs.datasette.io/en/stable/chan… 0.59.2 (2021-11-13) Co...

• • •

Missing some Tweet in this thread? You can try to force a refresh
　

Keep Current with Simon Willison

Simon Willison Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @simonw

Simon Willison Profile picture
12 Nov
I presented a 90 minute workshop on Git scraping and how to explore the resulting data using @datasetteproj at #CodaBr21 (by @EscolaDeDados) today

Here are the exercises from the workshop, plus additional screenshots and notes that I added afterwards

docs.google.com/document/d/1TC…
@datasetteproj @EscolaDeDados To save attendees from having to get a working Python environment setup on their laptop, I instead encouraged them to use a free @gitpod account (gitpod.io) - I demonstrated each exercise in GitPod too

Cloud-based development environments are SO GOOD for tutorials
(I had planned to use GitHub Codespaces for this, but then realized that those are not freely available to non-paid users outside of the beta program yet)
Read 6 tweets
Simon Willison Profile picture
21 Aug
Here's a fun challenge: given an array of datetimes, what's the best way to plot those on a frequency graph over time?

They might all be on the same day, or they might be spread out over several years - so the challenge is automatically picking the most interesting bucket size An example of the kid of chart I want to produce
Looks like d3.bin().thresholds() is the answer I'm looking for observablehq.com/@d3/histogram
Yup, this works perfectly: observablehq.com/@simonw/my-twe… Histogram of my tweets over time, generated with the followi
Read 6 tweets
Simon Willison Profile picture
9 Aug
Is there a reliable way to tell search engine crawlers that a site hasn't been updated in X days so they don't need to re-crawl it?

Do they tend to believe the <lastmod> element in sitemap.xml ? And can I set that to apply to the whole site, not just an individual page?
Asking because tailing logs shows a vast amount of crawler traffic to Datasette instances that haven't seen any data changes in over a year - I may have to robots.txt block crawlers from them to save in costs, but I'd rather tell them "no point in crawling, nothing has changed"
Datasette currently has a plugin for configuring robots.txt, but I'm beginning to think it should be part of core and crawlers should be blocked by default - having people explicitly opt-in to having their sites crawled and indexed feels a lot safer datasette.io/plugins/datase…
Read 4 tweets
Simon Willison Profile picture
28 Jul
Finally published my article describing the Baked Data architectural pattern, which I define as "bundling a read-only copy of your data alongside the code for your application, as part of the same deployment"
simonwillison.net/2021/Jul/28/ba…
I've been exploring this pattern for a few years now. It lets you publish sites to serverless hosts such as @vercel or @googlecloud Cloud Run that serve content from a read-only database (usually SQLite) - so they scale horizontally and can reboot if something breaks
It effectively gives you many of the benefits of static site publishing - cheap to host, hard to break, easy to scale - while still supporting server-side features such as search engines, generated Atom feeds and suchlike
Read 11 tweets
Simon Willison Profile picture
26 Jul
Anyone know of examples of SaaS apps that deploy stuff to your AWS account (lambdas, S3 buckets etc) using IAM credentials that you grant to the SaaS app? Is this a pattern anywhere?
I've seen examples of apps that will write your data to an S3 bucket that you own - various logging tools do this
Here's Fastly's documentation on setting that up: docs.fastly.com/en/guides/log-…
Read 8 tweets
Simon Willison Profile picture
11 Jun
A silly thing that puts me off using Docker Compose a bit: I frequently have other projects running on various 8000+ ports, and I don't like having to shut those down before running "docker-compose up"

Is there a Docker Compose pattern for making the ports runtime-configurable?
I'd love to be able to run something like this:

cd someproject
export WEB_PORT=3003
docker-compose up

And have the project's server run on localist:3003 without any risk of clashing with various other Docker Compose AND non-Docker-Compose projects I might be running
This looks like exactly what I want! The “.env” file You can set default values for any envir
Read 6 tweets

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Thank you for your support!

Follow Us on Twitter!

Like this author's thread?

Get emails when @simonw has new unrolls!

Check out other threads from @simonw!

Read all threads by @simonw

:(