Starts with the story of Rofecoxib (Vioxx).
Presents the evidence that didn’t get into the NEJM because one of the study authors was a paid consultant on the drug company producing Vioxx.
Carl recalls that he prescribed Vioxx and is vexed by the probability of harm he may have caused. Due to a COI impacting on the evidence he used to inform his medical practice.
And this was preventable if a better system was in place.
This slide is always revealing.
“Conflicts don’t impact on me. But they do on my peers”.
And they are starting this website (will share link if I find it). Just a small matter of waiting for @GOVUK and @gmcuk to make this standard practice. #whatareyouwaitingfor
@BoussageonR @LGHemkens @RecoveryDoctor @GuyattGH @AnilMakam Correct - for THIS meta-analysis.
I think you are conflating different issues & placing all of them under a "current 'E'/GRADE isn't fit for purpose" argument
I'll explain: in the CPAP meta-analysis example, you're right that GRADE could (the word could is important) be done
@BoussageonR @LGHemkens @RecoveryDoctor @GuyattGH @AnilMakam That is because GRADE does not stipulate a. what question(s) you ask, b. how you seek to answer them.
What it does do is provide a framework on how to determine the certainty of a body of evidence that you have decided (based on SR methods) addresses the question you have set.
@BoussageonR @LGHemkens @RecoveryDoctor @GuyattGH @AnilMakam If you choose to ask the question "Is CPAP effective in reducing both all-cause and cardiovascular mortality in patients with OSA?", and then YOU CHOOSE that evidence from RCTs AND Non-RCTs can inform this decision, that is not a function/requirement of EBM/GRADE.
Lots of takes on this. Many are what people have anyway regardless of this paper, such is the general diet/nutrition discourse, and particularly around UPF.
For those of you interested in what an actual evidence-based approach to this paper looks like, buckle up🧵
In my view it is a good example of pervasive issue in the way most medical/health research is interpreted, and this even includes the authors themselves.
What’s the issue?
IGNORING UNCERTAINTY!
2/
A key function of a systematic review is to inform as to how certain we can be that the available data provides an observable truth.
There are different methods a review team can take. One of the most commonly used in med/health research is GRADE.
"It's going to protect YOU..."
"It will reduce YOUR risk of a heart attack, cancer, diabetes etc".
We see this all the time when it comes to medical treatments and health interventions.
I'm going to show why 99.9% of the time this type of phrasing/framing ("YOU/R") is wrong🧵
When people hear these phrases with "YOU" / "YOUR" in them, it's most likely they will perceive the benefits & risks of treatment/intervention in relation to their own personal benefit/risk. The thing is, we do not, & cannot, know your own personal benefit/risk.
The vast majority of the time we only have information on groups of people (samples). Benefits/risks in this context relate to the numbers of people (with a similar health profile) among the group who either do or do not experience a given health outcome.
out of frustration of seeing an organisation promote evidence from a commentary piece as if it were proof a question had been answered. No uncertainty. Proof.
/1
The same organisation didn't mention a systematic review attempting to answer the same question (which happened to show uncertainty). Yes, the organisation was aware of the review's existence.
This signals, to me, an agenda. It's also a good example of the state of things.
/2
The state of things in relation to evidence and "evidence-based". It's a state I worry about, hence the original tweet.
This isn't about the topic/question. It's about the principle. Of promoting selected information as if it is proven fact, ignoring info that might contest.
/3
Our latest publication revisits a well-known problem: reporting of relative effect estimates without absolute effects in journal publications of clinical trials:
First an intro to the problem. A practical example is probably best here. Take a look at the image. How many more people are at increased risk bowel cancer?