Cecile Janssens Profile picture
Jan 24, 2020 13 tweets 5 min read Read on X
These days, researchers are so focused on data that they seem to forget the value and power of logical reasoning in science.

This week in journal club, we applied logical reasoning to evaluate the strength of hypothesis. Here is a summary.
1/
The most common forms are inductive and deductive reasoning.

In inductive reasoning, we use observations to infer a theory or hypothesis. In deductive reasoning, we use a hypothesis to make predictions about the observations, which are then tested by data.
Here’s an illustration of the difference between the two. In a deductive argument, the conclusion (c) follows from the premises (p) with certainty, and in an inductive argument with a probability. A conclusion from induction may be true, but no guarantee.
But what if the premises are false?

Deductive arguments are sound if the premises are true and the reasoning is valid. Inductive arguments are cogent if the premises are true and the reasoning is strong.
Because a conclusion follows from induction with uncertainty, adding premises can make an inductive argument stronger or weaker. Similarly, omitting(!) premises can make an argument *look* stronger or weaker.
Here’s are two examples of deductive reasoning in scientific research
And here is where the fun begins: the introduction of scientific articles can be summarized in the framework of inductive arguments, which shows the strength of the hypothesis. A pretty strong classic here.
Which looks even stronger after unraveling some hidden premises.
Here is the introduction of the recent trial on increasing vegetable consumption to reduce prostate cancer progression. Does this look strong?
Some more background was given in the protocol, but that made even more clear that essential observations were lacking that would have made the hypothesis stronger and the study more likely to deliver.
The lesson:
If you want your research to deliver, make sure your hypothesis is strong.

Unraveling the reasoning in scientific articles helps identifying strong studies. And fishing expeditions.
/end

The slides of this thread can be downloaded here: cecilejanssens.org/slides-from-tw…

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Cecile Janssens

Cecile Janssens Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @cecilejanssens

Aug 13, 2021
Children born during pandemic have lower IQs
"according to the analysis, which is yet to be peer-reviewed."

I'm not sure that's what the study found. Let's do some peer review:
1/

theguardian.com/world/2021/aug… @NatalieGrover
As you would have guessed, the study did not measure IQ in the babies. It measured early learning, verbal and non-verbal development.

This is not my field, but call me skeptic that this can be assessed *reliably* in babies <1 year old. What did you do in your first year?
A big red flag: the scientific article gives no details about the babies and the measurements. Who were they? Why were they eligible for the study? How were they selected? Were they randomly invited? Did parents sign them up? How were they tested?
Read 8 tweets
Apr 19, 2021
Ik heb de rapporten van het Fieldlab onderzoek doorgenomen. Een verontrustend draadje over bladzijde 11 van "Bijlage 5: Resultaten risico analyse" Image
Of evenementen al dan niet veilig zijn en zo ja onder welke voorwaarden wordt in dit onderzoek bepaald met een risicomodel. Dat is een gebruikelijke methode, maar er zitten haken en ogen aan.
Elk model is een versimpeling van de werkelijkheid die je in staat stelt om voorspellingen te doen. Bv, met een model kun je uitrekenen wat je netto gaat verdienen als je het brutobedrag weet.

Of de voorspelling uitkomt, en het model correct is, hangt af van 2 voorwaarden: ... Image
Read 9 tweets
Apr 4, 2021
Korte uitleg bij mijn column: waarom is het zo’n probleem wanneer deelnemers zichzelf voor onderzoek kunnen aanmelden?
1/

nrc.nl/nieuws/2021/04…
In enquete-onderzoek wil je dat deelnemers een afspiegeling zijn van de *doelpopulatie*, bv alle Nederlanders. *Alleen* als die afspiegeling *representatief* is gelden de resultaten van het onderzoek voor de hele doelpopulatie.
Een representatieve afspiegeling bereik je door deelnemers willekeurig uit te nodigen en te zorgen dat of iedereen meedoet of dat niet-deelname ook willekeurig is, dwz ongerelateerd aan deelnemer-kenmerken of voorkeuren.
Read 9 tweets
Feb 28, 2021
Ik schreef dit weekend een column over slechte wetenschap met daarin een nauwelijks-te-geloven voorbeeld over een index. Hier is een toelichting op de index met wat bronnen.
@nrc @nrcwetenschap
nrc.nl/nieuws/2021/02…
Hier is een oud draadje waarin ik de index uitleg en toelicht wat er mis is:
Mijn uitleg is zo simpel dat je 'm haast niet zou geloven. Hier zijn wat analyses van statistici:
ncbi.nlm.nih.gov/pmc/articles/P… (Pepe, Stat Biosci)
pubmed.ncbi.nlm.nih.gov/23553436/ (Hilden, Stat Med)
ncbi.nlm.nih.gov/pmc/articles/P… (Kerr, Epidemiology)

Lastige artikelen, maar heldere titels:
Read 9 tweets
Sep 30, 2020
Is searching scientific literature the most undervalued aspect of scientific research or is that my impression only?

I gave a lecture to our epi students on how to search literature for their theses.

Here's the essence, incl, I'm biased, how @CoCites makes searching easier.

1/ Image
Everyone who wants to do science needs to find out
- what the state of the art is on their topic, and
- how you set up a study that can move the science forward.
It's not 'any study will do'. Image
You will need that background research not only for the introduction of your thesis/paper, but for all of it. Doing science is more than running a data analysis ... Image
Read 18 tweets
Sep 21, 2020
@mauricedehond claimt dat het virus zich voornamelijk verspreidt via inhalering van airborne druppels, waarmee hij lijkt te doelen op aerosols.

De CDC tekst is verwarrend, maar betekent niet wat De Hond denkt.

Hier een overzicht van eerdere versies van de website.

1/
Het gaat om deze pagina van het CDC: cdc.gov/coronavirus/20…

In de versie van 28 maart was de verspreiding "mainly from person-to-person" en landde de virusdroplet nog op de mond of neus. (bron: Wayback Machine Internet Archive) Image
Maar ook toen werd al gedacht aan verspreiding via mensen die geen symptomen hadden, of via het aanraken van besmette oppervlakten of objecten. Dat waren echter niet "not thought to be the main way the virus spreads". Image
Read 7 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us!

:(