Judea Pearl Profile picture
Aug 5, 2019 5 tweets 3 min read Read on X
I have just posted my 3rd comment on Lord Paradox errorstatistics.com/2019/08/02/s-s…. Here, I returned to my original goal of empowering readers with an understanding of the origin of the paradox and what we can learn from it. Red herrings have been taking too much of our time. #Bookofwhy
It is important to add that the huge literature on Simpson's and Lord's paradoxes attests to a century of scientific frustration with a simple causal problem, deeply entrenched in out intuition, yet helplessly begging for a formal language to get resolved. I can count dozens of
red herrings thrown at this stubborn problem, to deflect attention from its obvious resolution. Why? Because the latter requires the acceptance of a new language - the hardest transition for adults. I am grateful for the opportunity to talk to thousands of young followers here
on Twitter and convey to them my honest conviction: Chapter 6 of #Bookofwhy (paradoxes galore) is a condense summary of a century of confusion, and a powerful recipe for deliverance from that confusion. Additional references are: ucla.in/2JeJs1Q (Lord's paradox),
ucla.in/2Jfl2VS (Simpson's paradox) ucla.in/2NTbnrS (Sure-thing Principle)
And Chapter 6 of Causality ucla.in/2BDDTLK , where I document dozens of red-herrings 1900-2000.
Their numbers is still rising, I hope one of you continues --an amazing phenomenon.

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Judea Pearl

Judea Pearl Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @yudapearl

Apr 3, 2023
Got my first session with GPT-4, amazing! Though it failed its first causal understanding test.
Me: "Is it possible that smoking causes grade increase on the average and, simultaneously, smoking causes grade decrease in every age group?"
GPT-4: It is theoretically possible
1/4
for smoking to cause an average grade increase overall while causing a grade decrease within every age group. However, this scenario would likely involve some form of Simpson's paradox, where the overall relationship between two variables reverses when accounting for
2/4
a third variable (in this case, age). ....etc.
It failed because (1) I asked a question the answer to which is "definitely NO, no exceptions", and (2) It read somewhere about Simpson's Paradox and a "third variable," overlooking that the question was explicitly causal,
3/4
Read 4 tweets
Jan 30, 2023
To understand how trialists, under additivity, can get away without causal calculus, it is instructive to see how selection bias cures itself in linear systems. Let's start with
Eq. (10) of ucla.in/2LcpmHz which, for any 3 variables, X,Y,W gives:
1/5
(10) beta_yx = beta_yx.w ( 1-beta_xw^2) + beta_xw * beta_yw
It says that the regression of Y on X can be written in terms of other regression coefficients, each and every one of which is conditioned on w. If we now think of W=1 as the index of selecting units into the study,
2/5
equation (10) implies that the regression of Y on X at the target population can be inferred from regressions estimated in the study, W=1, regardless of how X, Y and W are interacting.

Two distinct cases are worth noting.
(1) If W is a pre-treatment variable, as in Fig. 3,
3/5
Read 5 tweets
Dec 27, 2021
As the year draws to a close, many are looking back on the moments from 2021 that gave them hope and encouragement. Kenneth Markus lists his 10 Most Inspiring Moments in the fight against #antisemitism: jewishjournal.com/commentary/opi…
I would like to add another, missed by
1/5
the media, suppressed by our leaders, and hush-hushed by university administrators. Yes, I'm coming back to the USC scandal, and the 65 of its top professors who scored a huge victory through this letter: usc-faaz-12-2021.org. Here they defined in effect a new
2/5
minority group on US campuses: Identity Zionism, defined not by victimhood and
need of protection, but by its inspiring nation-building experience and ideas, its academic excellence, and its unique contributions to campus life. To appreciate the magnitude of the victory,
3/5
Read 5 tweets
Dec 4, 2021
Is it dumbness or deliberate blindness that prevents USC officials from listening to their students and faculty? Death threats were disseminated against Zionists. Incriminating statements were made against the very being of Israel. 60 distinguished professors are pleading 1/4
with USC leadership to explicitly de-criminalize Zionist and Israeli identities [quoting from their Letter]:
"Most importantly, Jewish, Zionist, and Israeli students, as well as those who support the right of the State of Israel to exist need to hear from our leaders that 2/4
they are welcome on our campus." Yet, stunningly, in their response, USC leaders blatantly and meticulously refrain from spelling out the words "Zionist" and "Israel", leaving thousands of students, faculty, staff, potential students, parents of USC students, and the
3/4
Read 4 tweets
Nov 27, 2021
A new book "Causation in Science, by Yemima Ben-Menahem makes the point that, in ordinary scientific practice, conservation constraints often serve as explanations. For example: "Why did the roller coaster slow down"? "Because energy must be conserved"
watermark.silverchair.com/fzab078.pdf?to…
1/4
To include such constraints as "causal explanations" Ben-Menachem advocates abandoning the paradigm that causation is a relation between events, or variables. I hesitate! Considering the fact that conversational utterances are in themselves products of language constraints, 2/4
they are hardly in a position to illuminate the nature of causation. To elaborate, all scientific languages, until 1920, were wedded to the symmetric algebraic equality "=", lacking notation for the assignment operator ":=", with which causal asymmetries can be expressed.
3/4
Read 4 tweets
Nov 11, 2021
1/5 Finding a do-operator in a @DeepMind article is a tectonic progress that deserves welcoming blessing. The "delusions" treated in this article are endemic of "Evidential Decision Theory" which Causality (ch 4.1.1 ucla.in/38bmhnO)
summarizes in a mnemonic limerick:
2/5
- Whatever evidence an act might provide
- On what could have caused the act,
- Should never be used to help one decide
- On whether to choose that same act.
Typical real life ramifications of these delusions are:
(1) patients should avoid going to the doctor “to reduce the
3/5
probability that one is seriously ill”
(2) workers should never hurry to work, to reduce the probability of having overslept, and more.
The deployment of the do-operator eliminates these "delusions" and has led to the "sequential backdoor criterion" of Sec. 4.4.3.
Read 5 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(