Ben Recht Profile picture
Jun 11 5 tweets 1 min read Twitter logo Read on Twitter
This is a great thread. But there is an alternative conclusion: Reproducibility crises themselves are overblown and missing the point.
There has never been a time in science when most published findings were true. And yet, many disciplines managed to have a profound impact nonetheless, why?
My take (which is probably wrong but I want to know why) is most of the retrospectively big successes in science were coupled to big successes in engineering.
In order to find out "what's true," you have to find out "what works."
Maybe a dark example here: which is better evidence of the theory of relativity? The Michelson–Morley experiment or the nuclear bomb?

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Ben Recht

Ben Recht Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @beenwrekt

Mar 7
There was a thread on here last week where two Turing award winners are jovially promoting the idea that mathematical statistics is better at determining causation than common sense. 1/10
We have known for at least 50 years that this is wrong, and yet academics continue to push this illusion.

Here are some of my favorite critiques… I’ll give 6 because I don’t believe in 93 part threads. 2/10
Meehl, 1978. "Theoretical risks and tabular asterisks: Sir Karl, Sir Ronald, and the slow progress of soft psychology." psycnet.apa.org/record/1979-25… 3/10
Read 10 tweets
Feb 12
I have a recommended reading list for Artificial Intelligence, and it hasn't changed since 2019. I give this list to my grad students, but all of the articles are broadly accessible if you're interested. Very short 🧵.
1) Ted Chiang's critique of the threat of superintelligence.

buzzfeednews.com/article/tedchi…
2) Maciej @Pinboard Cegłowski's Superintelligence: The Idea That Eats Smart People.

idlewords.com/talks/superint…
Read 6 tweets
Jan 19
The IBM 704 was the most amazing general purpose AI computer ever made.
Released in 1954, the 704 could compute 12 thousand floating point operations a second. And it ran on vacuum tubes.
The 704 was absurdly ahead of Moore’s Law scaling. In the imaginary world where Moore’s Law applied to tubes, we’d today have 80 petaflop workstations... though they’d probably need to be cooled with liquid helium.
Read 9 tweets
Feb 4, 2022
By now on this fine Friday you have all seen this terrible MMWR study. It has many flaws, but I particularly am incensed that it insults my favorite observational design, the test-negative control design.

cdc.gov/mmwr/volumes/7…
Test-negative control is used to evaluate vaccine effectiveness. It attempts to avoid confounding by restricting its subjects to those seeking medical attention.
People who seek treatment for a respiratory infection get tested for a disease. Those that test negative are the control group, and those that test positive are the treatment group.
Read 10 tweets
Feb 3, 2022
This short twitter thread provides a brief tutorial on how to read econ papers without knowing any math.
The intro will be in plain English and will usually claim some "counterintuitive surprise." But all of the main math results will be summarized in table 1 or table 2. 2/9
Each number in these tables represents an estimated quantity from some completely implausible statistical model the authors cooked up to "control for confounding effects." Usually the first entry is the only one you should care about. 3/9
Read 9 tweets
Feb 3, 2022
What are examples of observational data analysis leading to widespread, faulty scientific consensus?
Context: I ask because I just re-read a lovely essay "On Types of Scientific Inquiry: The Role of Qualitative Reasoning" by David Freedman. 2/10
Freedman goes through several impressive case studies whereby scientists made revolutionary discoveries on the basis of observational epidemiological data alone. 3/10
Read 11 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(