blogs I found this year
"What might become more valuable
Trustworthiness
Having a real audience
Doing things in real life
Craftspeople
Specializing
Being funny
Mental health
Agency and resourcefulness
Top ~10 percent creativity
Having good taste
Being adaptable
Kindness"
essays of 2024
If you forced modern ML developers to work with 2016-era computers, they would not be able to make 2024-quality AI, even with all their knowledge of transformers and so on. You cannot make 4500 kilograms of soap from 450 grams of oil.
(i don't stay current)
terrible year for my reading, the worst since I was like 8 years old. Something about writing up a thesis just drained all the text out of me.
Dec 8, 2024 • 23 tweets • 6 min read
albums of the year 2024
about 1000 new ones this year. (almost all got exactly one listen besides the following)
> After the operation, they reversed the flow of blood to my brain, hoping to flush out any debris that was about to disable my res cogitans. So I’ve been brainwashed.
Dec 4, 2024 • 42 tweets • 13 min read
breakthroughs of 2024
Primary endosymbiosis found!
New paper: a big 90-page intro to AI and its likely effects from ten perspectives, ten camps.
The whole gamut: ML, scientific applications, social applications, access, safety and alignment, economics, AI ethics, governance, and classical philosophy of life.
1/18
We inherited the framing (“Ten Hard Problems”) from Eric Schmidt and James Manyika. They conditionalise on success: "if it's 2050 and everything went well, what did we have to solve for that to happen?"
Intended audience: technical people without any ML experience.
Jan 5, 2024 • 45 tweets • 13 min read
Blogs I found this year
On steps-to-reach-loss, FLOPs-to-reach-benchmark, inference speed, etc, the mixture-of-experts paradigm gets between 2x~5x improvement over a dense baseline. Fundamentally, MoE is unfriendly to low vRAM developers, which describes the vast majority of OSS 152334h.github.io
Dec 27, 2023 • 31 tweets • 11 min read
ML in 2023
(not a calibrated accounting of All Progress, just what caught my haphazard eye)
This thread will of course overfocus on LLMs. At the start of the year, the stochastic parrot hypothesis was rampant. No longer.
best playlists I made this year
Foundtrack was an amazing blog that used to make mp3 playlists. It had a big effect on me. Some cuts are so deep that they're not on Spotify, Youtube, Soundcloud, Bandcamp...
notes on Mexico City
Pleasant to just walk around central CDMX. Trees everywhere, dogs, masterpiece buildings - but razorwire, flaking paint and bare concrete too, to make you realise they are masterpieces (not complacent like I am in perfect environs, e.g. Venice)
Full of noise, trees, and art.
Dec 14, 2022 • 4 tweets • 2 min read
This philosopher test from last week is accidentally insightful. Most of the questions are about vibes / social presentation / misanthropy. Valid dimensions to think about philosophers with! But not very philosophical.
idrlabs.com/philosopher-pe…
The test mostly just measures your condescension, drama, vibesmaxxing, misanthropy, nerdiness. Some important principal components of this demi-philosophy:
🧵
[Fiction]: Sylvie, a self-propagating harrassment bot with internet access who hounds privileged people with custom cruelty, sometimes to their deaths.
"his stalker had sent Harrison almost three hundred thousand messages over the course of six years"
How well do masks work against Covid at the population level?
In our new paper, we find mask-wearing corresponded to an international average 19% decrease in transmission (Rt).
(On average, 83% reported wearing some mask most of the time in public.)
doi.org/10.1073/pnas.2…
The puzzle: studies of individuals found big reductions in Covid transmission from masks, ~50%. But society-level studies trying to predict Covid rates from masks found inconsistent results [-2%, 40%].
Jun 19, 2021 • 13 tweets • 7 min read
How well do masks work against COVID transmission, at the population level?
In our new preprint, we find that an entire population wearing masks is linked to a reduction in R of 24.6% [6%, 43%].
medrxiv.org/content/10.110…
(In particular, this effect is that of an entire population reporting that they wore masks, in some or all public places, most or all of the time.)