A baby received a living heart-valve implant for the first time. This is a permanent solution where previously they received a series of "cadaver homografts" as they grew up.
"Every year, 300 million male chicks are... shredded alive in industrial grinders... in-ovo sexing can determine the sex of a chick before it hatches... unwanted eggs can be destroyed before... the embryo feels pain."
"Today, agonizing searches for a matched [marrow] donor are largely a thing of the past... Cyclophosphamide was first developed in the 1950s for chemotherapy... repurposed to prevent a common and sometimes deadly complication of bone-marrow transplants called graft-versus-host disease" theatlantic.com/health/archive…
A Google quantum error-correcting code has gone beyond break-even (the logical qubit lasts > twice as long as its physical qubits). Can now get the overall error rate down to one per million, good enough for a real computer.
New paper: a big 90-page intro to AI and its likely effects from ten perspectives, ten camps.
The whole gamut: ML, scientific applications, social applications, access, safety and alignment, economics, AI ethics, governance, and classical philosophy of life.
1/18
We inherited the framing (“Ten Hard Problems”) from Eric Schmidt and James Manyika. They conditionalise on success: "if it's 2050 and everything went well, what did we have to solve for that to happen?"
Intended audience: technical people without any ML experience.
We spent a chunk of 2022 and 2023 reviewing 1347 papers and talking to 30 experts.
**Importantly, we don’t really cover most of last year’s enormous progress in capabilities and governance.**
(Lesson: moving too quickly for a journal paper to be a very sensible exercise.)
On steps-to-reach-loss, FLOPs-to-reach-benchmark, inference speed, etc, the mixture-of-experts paradigm gets between 2x~5x improvement over a dense baseline. Fundamentally, MoE is unfriendly to low vRAM developers, which describes the vast majority of OSS 152334h.github.io
Foundtrack was an amazing blog that used to make mp3 playlists. It had a big effect on me. Some cuts are so deep that they're not on Spotify, Youtube, Soundcloud, Bandcamp...
Pleasant to just walk around central CDMX. Trees everywhere, dogs, masterpiece buildings - but razorwire, flaking paint and bare concrete too, to make you realise they are masterpieces (not complacent like I am in perfect environs, e.g. Venice)
Full of noise, trees, and art.
The food is as good as you think. Joint first in the world per dollar. Spice optional.
Chilaquiles (like nachos but way better) is a top-tier breakfast. And Chilpa is one of my favourite restaurants, for $5.