If we prioritized improving patients' and trainees' lives clinical psych's structures would look entirely different

A part touched on but (understandably!) not emphasized in this piece: There's vanishingly little evidence our training improves clinical outcomes for patients
🧵
Multiple studies with thousands of patients (though only 23-39 supervisors each!) show that supervisors share less than 1% of the variance in patient outcome

And that's just correlation, the causal estimate could be much smaller

tandfonline.com/doi/full/10.10…

journals.sagepub.com/doi/full/10.11…
There's evidence supervisors and trainees care more about a supervisors' "relational characteristics" than their "transmission of clinical know how"

It's ok to want to spend time with people we like, and there's no guarantee that will help patients

ncbi.nlm.nih.gov/pmc/articles/P…
But even if supervisors don't account for much variance in patient outcomes directly, maybe the experience gained in working with patients over time matters?

Unfortunately, the evidence we have for that is thin to nonexistent as well
A recent meta-analysis failed to find evidence that more experienced therapists improve symptoms or functioning more than less experienced therapists across 29 studies (though patients with more experienced therapists reported more treatment satisfaction)

ncbi.nlm.nih.gov/pmc/articles/P…
These findings align with decades of converging evidence that folks with less experience can deliver mental health interventions as well as experienced professionals (ie help patients get at least as much better)

psycnet.apa.org/record/1979-31…

ncbi.nlm.nih.gov/books/NBK80017/
They also align with analyses that therapists get at worst slightly less helpful to patients over time during training or at best minimally (d = 0.04) more helpful over time during training (Small therapist Ns though)

psycnet.apa.org/doiLanding?doi…

researchgate.net/profile/Tony-R…
Before you @ me, I know absence of evidence ≠ evidence of absence, and I wish the quality of these studies were MUCH higher

However, an institution that prioritized improving patients' and trainees' lives would have invested in rigorously testing our training model already
If less training is required to help people than our current model of "accumulate a ludicrous number of clinical hours while also doing 16 other jobs" we could improve trainees' lives by reducing hour requirements

researchgate.net/profile/Robert…
There's solid evidence we could prepare trainees in a much shorter amount of time

Trainings that take *much* less time than PhD programs (80 hours or less vs. 500 or more) can lead to medium effect sizes on patient outcomes vs control conditions in RCTs

annualreviews.org/doi/10.1146/an…
Even if our training improves patient outcomes more than the current evidence suggests, we could still do better

How long are we going to keep enshrining powerful people's personal preferences instead of investing in rigorously evaluating how we could do better as a field?
I'm not optimistic, and I hope I'm wrong
A clinical psychology that prioritizes improving patients' and trainees' lives would invest in evaluating whether its current training models accomplish those goals

And if those goals are not being met, we would prioritize solutions that center patients' and trainees' well-being
Or, if you would prefer the thrust of this thread in a succinct tweet

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Dr. Michael Mullarkey

Dr. Michael Mullarkey Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @mcmullarkey

1 Oct
If you ever want to sound like an expert without paying attention, you only need two words in response to any question

"It depends"

A thread on why we should retire that two word answer 🧵
When people say "it depends" they often mean the effect of one variable depends on the level of at least one other variable

For example:
You: Does this program improve depression?
Me, Fancy Expert: Well, it depends, probably on how depressed people were before the program
Understandably you'll want some evidence for my "it depends"

Luckily my underpaid RA has already fired up an ANOVA or regression, and *I* found that how depressed folks were before the program moderated the effect of the program

"It depends" wins again?

Nope, so many problems
Read 23 tweets
30 Sep
Figuring out what causes what is SO HARD

And especially if you have a psych background, you might think we *need* an experiment to understand causes

While I love experiments, here's a thread of resources on why they're neither necessary nor sufficient to determine causes 🧵
This paper led by @MP_Grosz is a great start! It persuaded me that merely adjusting our language (eg saying "age is positively associated with happiness" instead of "happiness increases with age") isn't enough

journals.sagepub.com/doi/full/10.11…
If our underlying research question is causal, we still need causal methods! But if they're not just experiments, what are the options?

Luckily for us @dingding_peng has a must-read primer on using causal methods with non-experimental data

journals.sagepub.com/doi/10.1177/25…
Read 13 tweets
27 Sep
Where should folks turn if they want mental health support for depression *right now* and aren't in crisis?

Traditional talk therapy often has long waitlists

The therapy apps you've heard about promising quick access to treatment have lots of problems

What I recommend 🧵
Adults Part I

Program: Deprexis
Content: 10 self-guided, internet-based modules (most grounded in evidence-based approaches)
Cost: ~1-2 sessions of therapy ($280)
Evidence: Solid meta-analytic evidence across >10 RCTs journals.plos.org/plosone/articl…
Link: orexo-store-2.mybigcommerce.com
Adults Part II

Program: MoodGYM
Content: 5 self-guided, internet-based modules (all grounded in CBT-based approaches)
Cost: <1 session of therapy ($27)
Evidence: Somewhat shaky meta-analytic evidence across >10 RCTs researchgate.net/profile/Conal-…
Link: moodgym.com.au
Read 8 tweets
19 May
Still responding to folks re: my transition to data science post! I'll get to everyone, promise!

Given the interest I thought people might want to know the (almost all free/low cost!) resources I used to train myself for a data science role

A (hopefully helpful) 🧵
R, Part I

My first real #rstats learning experience was using swirl. I loved that I could use it inside of R (rather than having to go back and forth between the resource and the RStudio console)

swirlstats.com/students.html
R, Part II

A cliche rec, but it's cliche for a reason. R for Data Science by @hadleywickham & @StatGarrett transitioned me from "kind of messing around" to "wow, I did that cool thing" in R. It's absolutely a steal that it's available for free

r4ds.had.co.nz
Read 14 tweets
28 Feb
I just found out a paper we first submitted ~3 years ago was accepted! We used an N > 1,000 sample, open data/code, and robust methods

I'm proud of this paper, and it also helped radicalize me against a lot of the stories we tell ourselves about peer review

A 🧵
The many reviews we received were almost uniformly hostile, confused, non-constructive, or some combination
The paper definitely got better throughout the process, and that had ~0 to do with the reviews

Real reason #1: A wonderful, ongoing collaboration with a stellar biostatistician/many other great collaborators

Real reason #2: I got better at coding/new tools became available
Read 22 tweets
5 Sep 19
Trying to balance:
- Having genuine empathy for people who are staring down the barrel of their life's work not replicating
- Not reinforcing power structures and practices that led to a world where those barrels are all too common
Hearing @minzlicht talk about this on the "Replication Crisis Gets Personal" @fourbeerspod episode brought home to me how lucky I am to be early in my career now as opposed to 20 or even 10 years ago
But his example* reminds me people in power have a choice when confronted with a much messier literature than initially described

They can double down, or they can engage meaningfully with a more complicated world

*And many others, my mentions aren't ever comprehensive!
Read 12 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!

Follow Us on Twitter!

:(