Thread by @EpistemicHope

Here's my theory of the cluster of people that call themselves post-rationalists.

Long ago, @ESYudkowsky wrote the sequences. The sequences had a lot of explicit content, but they also had a "vibe."

@ESYudkowsky The vibe was something like "intelligence dominates everything; the way to power and winning is thinking really well. If you think well enough, you will be awesome."

Also, "arrogance and snark about how insane everyone / the world is."

Also, "ambitious, heroic, glorious."

@ESYudkowsky People read the sequences, and they got whatever they got out of them, but a LOT of what people picked up on was the "vibe".

@ESYudkowsky For instance, one major thing that I got from the sequences is that "rationalists should win". That I should be able to get what I want by being clever, and that I shouldn't often be in situations where I'm not getting what I want. And I should be indignant about them.

@ESYudkowsky In 2015, this became a sort of mantra for me.

In places where other people would be satisfied with the lemons that life gave them, _I_ should win.

@ESYudkowsky The actual post where it says that rationalists should win, is about Newcobm's problem: it's a pretty abstract point about the philosophy of rational choice.

@ESYudkowsky I mostly wasn't, in this instance, making use of the explicitly stated content. It's not like I was using some _specific_ reasoning technique that is more effective than baseline, and that's why I would win.

I was adopting an attitude that I picked up on.

@ESYudkowsky (Compare this to the case where a person reads the sequences and starts doing explicit Bayesian calculations, all the time, and expects to do better that way. In doing that, a person is responding more to the content, and less to the vibe.)

@ESYudkowsky I want to emphasize that there's a kind of arrogance, here, of "I'm different than other people, such that they sometimes don't get what they want, but that is beneath my dignity", which I totally had before reading the sequences.

@ESYudkowsky I didn't get this entirely from Eliezer. Rather, Eliezer put out a thing that resonated with me.

The sequences matched with, and _justified_ some attitudes that I already had. And they inculcated some new attitudes in me, via mimesis.

@ESYudkowsky That's not unique to me. Many of the people who were attracted to the sequences, were attracted by the _vibe_, mostly.

It isn't like people were ignoring the explicit content, but reading the sequences is FUN for some people.

@ESYudkowsky Some of that is because it is just so fascinating.

But some of it is because you either resonate with, or enjoy, or feel ego-boosted, by the vibe.

@ESYudkowsky You'll like the vibe of the sequences more if you like the the snark and the superior attitude, instead of people who were offended by it. Or if you are proud of your intelligence, maybe?

@ESYudkowsky So the sequences predictably attracted some particular types of people:

@ESYudkowsky - Some people who are smart and non-functional, and sincerely see "rationality" as a way to turn their life around, which is comfortable for them, because it involves doing what they were already good at: school stuff / playing with ideas.

@ESYudkowsky - Some people who are smart and non-functional, who are less trying to be better, and more looking for a way to feel like _they're_ actually the superior ones; everyone else is irrational, and that's what matters.

@ESYudkowsky - Some people who want to feel important, and found this x-risk narrative as a way to feel important, or have meaning.

- Some people who resonate a lot with "thinking better is the path to success", because that has actually worked for them in their experience.

@ESYudkowsky - Lots and lots of people who were nerd-sniped by the ideas, and find social satisfaction from the rationalist social game: jockeying with each other to show how much you know by bringing to bear community shibboleths and/or generically "smart frames" on a question.

@ESYudkowsky The "people pick up on the vibe of the sequences" effect is magnified, because if you went to a rationalist meetup, it would be filled with people who self selected on the basis of resonating with or liking the vibe of the sequences.

@ESYudkowsky **And if the explicit content deviates from the vibe, the content sometimes gets lost or muddled.**

@ESYudkowsky This paragraph explicitly says "Don't be a straw Vulcan. Rationality is not about being emotionless!"

But also, the energetic "feel" of this paragraph, for me, is abstracted, and cognitive, and kind of keeping the emotions at arms length.

@ESYudkowsky And people will often interpret sentences like these according to the vibe that they project on to them.

And the result is that people say words like "rationality is not about only using your S2", but ALSO they mostly end up trying to do things with explicit S2 thinking.

@ESYudkowsky People manage to do things like ignoring their emotions (while also thinking they're awesome at emotions).

And it is pretty hard to notice if you're doing something like this!

lesswrong.com/posts/qmXqHKpg…

@ESYudkowsky So "rationality" for a lot people, is, for better or for worse, largely about that vibe.

@ESYudkowsky (Especially, though not uniquely, for people who are far from the in person community. People who live in the Bay have more feedback channels with how this rationality stuff lives in the likes of Eliezer, and Anna.)

@ESYudkowsky And sometimes people live by that ethos for a while, and then find that it doesn't serve them.

Like, the stance that they're taking towards the world, or towards themselves, isn't good for them, and doesn't help them get what they want.

@ESYudkowsky The way they relate with their emotions is bad for them.

Or the way they "overthink" things is neurotic instead of helpful.

Or the way that they intellectualize everything is isolating. They're not actually satisfied with the human connection that they get that way.

@ESYudkowsky And so they reject the ethos which they've come to associate with "rationality". (Which, they probably learned, in part, from the sequences, an in part had all along.

@ESYudkowsky And, even if they were doing it all along, rationality culture probably gave them some new and better tools and justifications for hurting themselves.)

@ESYudkowsky But when they reject the rationality ethos, something kind of funny happens, because every time they make a specific claim about what they're rejecting, some rationalist (like me!) will pop up and point out that the specific claim that they're making about why...

@ESYudkowsky ...rationality is not adequate is not only a thing that rationalists are aware of, but is RIGHT THERE in the sequences!

@ESYudkowsky They'll say something like "rationality is about thinking through everything, explicitly, and that's not actually effective."

@ESYudkowsky And then I and others will face-palm and be like "did you READ the sequences? Attend a CFAR workshop? We say in a like a hundred places that the point is not to reason through everything explicitly!"

https://twitter.com/ESYudkowsky/status/1462132727583440896?s=20&t=FolWro3qRBjTNunPfMLCFg

@ESYudkowsky But that's ok. People picked up on a vibe, and the way they embodied that vibe didn't get them what they valued, and so they're correctly pushing back against a vibe that they don't want.

@ESYudkowsky In summary:

It's all good. People should do things that are good for them.

Communication is hard.

It might be nice if people were more curious about how "rationality" sits in others, instead of fighting about what it is or isn't. But no one has to do that either. : )

@ESYudkowsky Does this description leave out anything important?

Or is it importantly wrong in any way?