Profile picture
Lorena Barba @LorenaABarba
, 10 tweets, 4 min read Read on Twitter
Five hours in @Reagan_Airport and still here; twice rebooked due to thunderstorms—hope I make it to Boston tonight for tomorrow's IEEE #reproducibility workshop.
As the @IEEEorg steps into the #reproducibility discussion, I'm really hoping they'll pay attention to terminology—"Terminologies for Reproducible Research"
My assessment after reviewing literature from more than a dozen fields is that the predominant usage for #reproducibility is “same data+same methods=same results.”
The predominant usage for #replication is “new data and/or new methods in an independent study=same findings.”
The semantic distinction between "replicate" and "reproduce" goes back at least a dozen years, to "Reproducible epidemiologic research" by @rdpeng et al.…
The Artifact Review and Badging effort of @TheOfficialACM, unfortunately, swapped the meaning of the terms "replicate" and "reproduce," as predominantly used…
The ACM adopted definitions based on the International Vocabulary of Metrology, which establishes terminology for physical measurements. The IVM document contains no definition of “replicability” [PDF]…
The scenario for the IVM definitions is measurement of a physical quantity, and associated precision. Reproducibility of measurements involves changing at least one condition—e.g., the instrument, the location, or the operator—to measure the _same_ quantity.
Reproducibility of measurement is expressed by a dispersion statistic, like standard deviation—because it refers to the _same_ quantity being measured.
Along the way of creating the ACM terminology, based on the metrology document, some leap occurred. Arguably, conditions for physical measurements are a distant analogy for the complex processes of a full scientific workflow. #reproducibility
Missing some Tweet in this thread?
You can try to force a refresh.

Like this thread? Get email updates or save it to PDF!

Subscribe to Lorena Barba
Profile picture

Get real-time email alerts when new unrolls are available from this author!

This content may be removed anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member and get exclusive features!

Premium member ($3.00/month or $30.00/year)

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!