Marion Campbell Profile picture
Apr 24 9 tweets 3 min read Twitter logo Read on Twitter
One phenomenon that can affect clinical trials is the #HawthorneEffect. This is when purely being involved in a trial can improve performance. 1/9
#MethodologyMonday
The #HawthorneEffect was named after a famous set of experiments at the Hawthorne Western Electric plant, Illinois in the 1920/30s. 2/9
In one experiment lighting levels were repeatedly changed & with each change, productivity increased .. even when reverting to poorer lighting. This was attributed to workers knowing their work was being observed. Productivity returned to normal after the experiments ended 3/9
In clinical trials the effect can manifest in improved performance in the control group (compared to normal practice) due to being in a trial and having to report on it. This can lead to the intervention effect potentially being diluted & the power of the study being affected 4/9
Having an integrated #ProcessEvaluation in the trial can be crucial to identifying if normal practice is being affected by involvement in the trial. It also allows for timely refinement of trial processes to minimise any deviations from normal practice thus minimising effects 5/9
Additionally Data Monitoring Committees regularly review the emerging data from both intervention and control groups and may be able to identify early if the trial control rates assumptions are not holding. This may potentially lead to a review of sample size assumptions 6/9
An alternative strategy possible in some fields (eg guideline evaluation) is to adopt an active control in an attempt to address the Hawthorne effect directly through use of designs such as a balanced incomplete block or Latin square design. 7/9
sciencedirect.com/science/articl… Image
Here one group implements guidelines for condition 1 and acts as a control for condition 2; whilst the other reverses this - implements the guideline in condition 2 but is control for condition 1 (thus both are interventions and controls - equalising the Hawthorne effect) 8/9
There remains a lot of uncertainty however about the range of non-specific effects seen in trials. As flagged by McCambridge et al there is a real need for research (& likely development of new concepts) to further clarify the types of effect observed 9/9
jclinepi.com/article/S0895-… Image

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Marion Campbell

Marion Campbell Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @MarionKCampbell

Apr 17
This week some of my discussions have centred on #ClusterTrials. Cluster trials involve the randomisation of intact units (wards, hospitals, GP practices etc) rather than individuals. They have a number of key elements that must be accounted for 1/11
#MethodologyMonday
There are very good reasons for cluster/group randomisation eg when evaluating interventions like clinical guidelines or educational interventions which apply at practice/hospital level; or when there is potential of contamination of the intervention across trial groups 2/11
However, cluster randomisation has some major impacts for design & analysis primarily because observations within a cluster are not independent (outcomes are likely to be more similar within a cluster) 3/11
Read 11 tweets
Apr 3
The first step in a clinical trial is deciding the #ResearchQuestion. Knowing which question is most important to focus on may not be clear cut. An interesting paper was recently published which developed a tool to rank the importance of research questions 1/7
#MethodologyMonday
This tool was developed for the musculo-skeletal field (ANZMUSC-RQIT), but the concepts are highly likely to be transferable to other fields 2/7
journals.plos.org/plosone/articl…
The tool identified 5 domains to be ranked:1) extent of stakeholder consensus, 2) social burden of health condition, 3) patient burden of health condition, 4) anticipated effectiveness of proposed intervention, and 5) extent to which health equity is addressed by the research 3/7
Read 7 tweets
Mar 27
There was an interesting paper this week on different stakeholders understanding of the concept of #equipoise. Equipoise is an essential concept in clinical trials but is often not well understood 1/8
#MethodologyMonday
For it to be ethical to randomise in a trial, it is important that there is uncertainty which treatment is best 2/8
Originally uncertainty (equipoise) had to be at the level of the individual clinician but was refined to uncertainty at the professional community level by Freedman in the 1980s 3/8
nejm.org/doi/full/10.10…
Read 8 tweets
Mar 20
The #FactorialTrial design is one of the very original efficient trial designs yet its potential often remains underused 1/7
#MethodologyMonday
In a #FactorialTrial you can evaluate the effectiveness of more than one treatment simultaneously and for the same sample size requirements as doing a single trial 2/7
bmcmedresmethodol.biomedcentral.com/articles/10.11…
For a factorial trial of say 2 treatments, patients are allocated to 1 of 4 groups: Gp1 receives both treatments A and B; Gp2 receives only A; Gp3 receives only B; and Gp4 receives neither A nor B (the control) 3/7
cambridge.org/core/services/…
Read 7 tweets
Mar 13
A clinical trial design that is often misunderstood is the #NonInferiority clinical trial design. 1/8
#MethodologyMonday
Mostly we set up trials to test if a new treatment is better than another (ie we test for superiority) but in a #NonInferiority design we wish to test if a treatment is not unacceptably worse than a comparator. 2/8
The main reasons why we might look for non-inferiority is when an alternative treatment is say much cheaper, or has fewer side effects … but we would only wish to use it if the benefits of the standard treatment are not significantly compromised. 3/8
onlinelibrary.wiley.com/doi/full/10.10…
Read 8 tweets
Mar 6
Having spent the last couple of weeks discussing composite & surrogate outcomes, I was reminded this week of the importance of thoughtful planning on the choice of outcomes in the first place 1/6
#MethodologyMonday
In particular I was reminded of the fundamental work of #Donabedian to conceptualise what is important to measure to assess quality of (and improvement in) health care. Although developed decades ago, it remains just as relevant today 2/6
jamanetwork.com/journals/jama/…
When we seek to assess the impact of a new intervention on care, the Donabedian model suggests there are 3 elements that may be impacted - the #structure the #process and the #outcome of care 3/6
Read 6 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(