, 5 tweets, 4 min read Read on Twitter
Last year, @NIMH_RDoC @NIMH commissioned a report from us @McLeanHospital (w/ @DanielGDillon @JustinBakerMD @laurenrutterr) re digital cognitive assessments for field test use, from >300k TestMyBrain participants. That report is now available! psyarxiv.com/dcszr/
Key findings: First, (1) *RELIABILITY IS A MAJOR ISSUE*, particularly for tasks from basic science / experimental traditions, built for detecting within person diffs and where reliability for between person is rarely reported. #psychometrics <- probably not trending
Second, (2) measures of negative valence / emotion (e.g. threat processing) and positive valence (e.g. reward sensitivity) usually not built for large-scale mobile assessment: technically, psychometrically, or re engagement - important for projects like @AllofUsResearch
Third, (3) Device variability is an issue for #digitaltechnology, particularly mobile cognitive assessments. Devices differ! Measurements of response time latency can differ by as much as 100ms between different smartphones. See also tandfonline.com/doi/full/10.10…
Fourth, (4) and can't stress this enough: participant engagement matters. We have N=300k in #citizenscience because the participant is a key stakeholder. And (surprise! win-win!) tests with better psychometric properties had better participant ratings and better retention!
Missing some Tweet in this thread?
You can try to force a refresh.

Like this thread? Get email updates or save it to PDF!

Subscribe to Laura Germine
Profile picture

Get real-time email alerts when new unrolls are available from this author!

This content may be removed anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

Follow Us on Twitter!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!