Last year, @NIMH_RDoC@NIMH commissioned a report from us @McLeanHospital (w/ @DanielGDillon@JustinBakerMD@laurenrutterr) re digital cognitive assessments for field test use, from >300k TestMyBrain participants. That report is now available! psyarxiv.com/dcszr/
Key findings: First, (1) *RELIABILITY IS A MAJOR ISSUE*, particularly for tasks from basic science / experimental traditions, built for detecting within person diffs and where reliability for between person is rarely reported. #psychometrics <- probably not trending