Sometimes the value of a 'human touch' is negative. People willing to pay 50% more for Waymo than Lyft, despite longer waiting times. Waymo's insane growth chart:

If you make $100-200k in a white collar job, studies suggest you're most exposed to AI automation

But what people miss: while AI reduces demand for some skills, others get MORE valuable

I spent weeks analysing existing research, job data, and how AI works to sum up which ones: /2 These skills increase in value (for now) because they fall into 4 categories:

• Hard for AI (messy, long-horizon, data-poor, human-in-the-loop tasks)
• Needed for AI deployment
• Produce things we want much more of
• Difficult for others to learn

The best skills hit 2+ categories.

1/ It's true software engineering employment seems to have flattened, but it's unclear this has much to do with AI. 2/ All job postings boomed in 2022 post-COVID, then fell. Software engineering merely showed a more exaggerated version of this trend.

Why to quit your job and work on risks from AI (the short version) 🧵 1/ There's a significant chance of AI systems that could accelerate science and automate many skilled jobs in five years.

80000hours.org/agi/guide/when…

AGI by 2027?

I spent weeks writing this new in-depth primer on the best arguments for and against.

Starting with the case for...🧵 1. Company leaders think AGI is 2-5 years away.

They’re probably too optimistic, but shouldn't be totally ignored – they have the most visibility into the next generation of models.

1/ Most AI risk discussion focuses on sudden takeover by super capable systems.

But when I imagine the future, I see a gradual erosion of human influence in an economy of trillions of AIs.

So I'm glad to see a new paper about those risks🧵 2/ We could soon be in a world with millions of AI agents, growing 10x per year. After 10 years, there's 1000 AIs per person thinking 100x faster.

In that world, competitive pressure means firms are run more & more by AI.

People are saying you shouldn't use ChatGPT due to statistics like:

* A ChatGPT search emits 10x a Google search
* It uses 200 olympic swimming pools of water per day
* Training AI emits as much as 200 plane flights from NY to SF

These are bad reasons to not use GPT...🧵 1/ First, we need to compare ChatGPT to other online activities.

It turns out its energy & water consumption is tiny compared to things like streaming video.

Rather than quit GPT, you should quit Netflix & Zoom.

The AI safety community has grown rapidly since the ChatGPT wake-up, but available funding doesn’t seem to have kept pace.

What's more, there’s a more recent dynamic that’s created even better funding opportunities, which I witnessed in a recent grantmaking round.. 1/ Most philanthropic (vs. government or industry) AI safety funding (>50%) comes from one source: Good Ventures.

But they’ve recently stopped funding several categories of work:

a. Republican think tanks
b. Post-alignment work like digital sentience
c. The rationality community
d. High school outreach

How can you personally prepare for AGI?

Well maybe we all die. Then all you can do is try to enjoy your remaining years.

But let’s suppose we don’t. How can you maximise your chances of surviving and flourishing in whatever happens after?

The best ideas I've heard so far: 🧵 1/ Seek out people who have some clue what's going on.

Imagine we're about to enter a period like COVID – life is upended, and every week there are confusing new developments. Except it lasts a decade. And things never return to normal.

In COVID, it was really helpful to follow people who were ahead of the curve and could reason under uncertainty. Find the same but for AI.

Just returned to China after 8 years away (after visiting a lot 2008-2016). Here's some changes I saw in tier 1/2 cities 🇨🇳 1/ Much more politeness: people actually queue, there's less spitting, and I was only barged once or twice.

But Beijing still has doorless public bathrooms without soap.

10 points about AI in China (from my recent 2-week visit) 🇨🇳

And why calls for a Manhattan project for AI could be self-defeating. 1/ China's AI bottleneck isn't compute – it's government funding. Despite export controls, labs can access both legal NVIDIA A800s and black-market H100s. Cloud costs are similar to the West.

ft.com/content/10aacf…

How much should you do what seems right to you, even if it seems extreme or controversial, vs. moderate your views based on other perspectives?

Moderate too much & you'll never do anything novel or ambitious. And "common sense" has often supported evil things in the past..

A 🧵 But acting on a narrow view of what's right can easily be dangerous - since you're most likely wrong - and has led to some of the worst atrocities in history.

So how to how much to moderate vs. go with what seems right to you?

It's been a wee bit frustrating to watch so many people start to take AI risk seriously after GPT-4..

..when it was clear these capabilities would arrive *eventually*, and before 2020 you could see deep learning had a good shot of producing them soon

arxiv.org/abs/1712.00409 Don't make the same mistake again. Imagine a far more advanced GPT-10 is here now. How worried *then* would you be about AI risk?

And how likely are these capabilities to arrive eventually?

How anyone can practice effective altruism:

Effective altruism often gets simplified to specific actions (donate 10%; take one of these jobs), which can be alienating if you can't do these actions.

But it's actually a way of thinking that anyone can apply.

/1 Here's a series of steps for applying effective altruism to your life, which I've been toying with, and keep at the back of my mind when advising people.

It's designed to be applicable no matter which causes you focus on, your background, or degree of altruism.

/2

The metaculus forecasting community seems to think unaligned superintelligence is coming soon...

...but everything will be fine.

First, they forecast a 50% chance general AI arrives by 2038:
metaculus.com/questions/5121…

/1 Then after general AI arrives, they forecast a 75% chance of superintelligence within 7 years (2045):

metaculus.com/questions/4123…

/2

Is AI coming sooner than we thought?

A thread..

(Tldr: a bit)

/1 There have been some amazing recent AI advances:

PaLM exhibited superhuman ability to explain jokes:

https://twitter.com/xuenay/status/1511246753592393731

DALL-E can understand artistic styles:

https://twitter.com/sama/status/1511715302265942024

Socratic models can combine common sense across domains:

https://twitter.com/andyzengtweets/status/1512089759497269251

/2

People joke that fusion has been 30 years away for 30 years.

Here's an actual projection from 1976.

It says fusion was possible within 30 years, *if* funding was increased several-fold.

Actually funding decreased – a scenario they called "fusion never"

Despite this..

1/3 Despite little funding, progress towards fusion 1970-2000 was good.

(The 'triple product' is a measure of the conditions that produce fusion. If you get it high enough, you start producing enough energy for a commercial reactor - shown by the dashed lines.)

2/3

The Fabian Society's 10-step playbook for creating democratic socialism ➡️ the welfare state:

1. Be a group of intellectuals
2. Host fun freewheeling fortnightly debates
3. Get really good at debating
4. Give a ton of talks
5. Recruit one of your generation's best writers

/1 6. Produce a ton of pamphlets explaining new ideas in a plainspoken way (with👌design)
7. Have your members enter local government
8. Wait several decades to work their way up
9. Have major influence on British politics.
10. From there influence India, Singapore, Nigeria etc.

/2

If you live in a NATO city, is it time to leave town?

Suppose your life expectancy is 50 years, you're 10x more likely to survive a nuclear war in the countryside

and there's a 0.04% chance of a large nuclear war this year, then...

https://twitter.com/ben_j_todd/status/1497203287501639689

/1 You'd stand to gain a week of life expectancy by skipping town for a year.

This would only be worth it if your life isn't made 2% worse by relocating.

/2

Recent events are a good reminder that:

just as a major pandemic was a realistic possibility in our lifetimes..

...so is the chance of a great power conflict

and that could lead to nuclear war..

/1 What's the risk of a US-Russia nuclear war? Some estimates:

My colleague did a survey of surveys: 0.4% per year
rethinkpriorities.org/publications/h…

135 forecasters: 10% chance of large nuclear war by 2050.
metaculus.com/questions/3517…

8% chance of WW3 by 2100.
forum.effectivealtruism.org/posts/aSzxoj7i…

/2

What's the most effective way to tackle climate change?

My take on research in effective altruism to date.

It seems that many popular approaches (eg recycling, planting trees) don't obviously work or are expensive ($100+ per tonne CO2), but...

/1 By focusing on more neglected, high-leverage solutions, you can probably reduce CO2 for under $1/tonne, and have 100-times the impact.

How?

/2