Raphael Nishimura Profile picture
May 11 34 tweets 8 min read Twitter logo Read on Twitter
Live tweeting the #AAPOR session The Panel on the Panel: Development and Testing of a Probability-Based, Nationally-Representative Survey Panel for Federal Use
First is Victoria Dounoucus (RTI) presenting Qualitative Work to Inform Contact Materials and Baseline Questions for the Ask U.S. Panel Pilot Image
Cognitive interview in Microsoft Teams for ~1 hour, with 30 interview (21 in English, 9 in Spanish)
First they tested the logo.
Winner logo was #4:
They like the US map and how the check mark indicated action Image
Asked their understanding of "panel"
They understood was a selected sample for a survey, but did not mention participating in the survey over repeated times
When asked again after receiving some information about the panel the understanding continues the same.
Action: Including the expression "over time" in the invitation letter to clarify that.
Next presenter is Dustin Williams (RTI) presenting Methods and Experimental Evaluation of Strategies for Online Panel Recruitment Image
Image
Respondents with no internet were provided a tablet with a paid internet plan.
4 of 53 respondents that were provided a table completed the topical survey and none completed the final survey 😱😅
Image
Response Rates Image
Image
Next is Amanda Smith (RTI) talking about Just Scan It: The Effectiveness of Including QR Codes in Panel Recruitment Materials Image
Why QR codes?
Reduce burden and mitigate error in typing URLs
Pre-COVID: QR codes were not very often used
Post-COVID: QR are everywhere! (Seriously! Can we just stop using QR codes for menu restaurants? 😛
Two mechanisms to acess web survey:
1) QR code
2) URL

Note: taking this pic was a bit difficult because my phone kept trying to read the QR code 😂 Image
Much higher use of QR code than previous study! Image
Half of mobile respondents used QR code and the majority of them are smartphones Image
Characteristics by model of access ImageImageImage
Image
Next is Carlos Macuada (RTI) talking about Tailoring Materials to Respondents: Heterogeneous Treatment Effects in Survey Experiments Image
To tailor the survey materials we need to have a good understanding of the population.
Are there differences across different subgroups with respect to certain design features?
Used BART to answer this question.
Results: ImageImageImageImage
Next and last presenter of the session is Emilia Peytcheva (RTI) presenting Evaluation of Nonresponse Bias in the Ask U.S. Panel Pilot Image
Focus on nonresponse bias at receuitment
Two-phase design with subsampling for nonresponse:
* Face-to-face
* Additional $5 incentive
* Provide tables
Image
Weighted screening response rates:
Phase 1: 14%
Overall (Phase 1 + Phase 2): 37%
Image
ImageImage
Examined 298 estimates
14% of them found significant "bias"
Results: ImageImageImageImage
That's a wrap! Great session about how Census is working in building a national panel!
/TheEnd
@threadreaderapp compile unroll thread

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Raphael Nishimura

Raphael Nishimura Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @rnishimura

May 12
Live tweeting session Detection and Mitigation: Developing Monitoring Tools to Ensure Quality in Interviewer-Administered Data Collection at #AAPOR
First is Joe Murphy (RTI) presenting A Dashboard for Field Survey Data Quality Management Image
Why an *interactive* dashboard?
Different users, different needs
Gives user control to what they need
Read 19 tweets
May 12
Live tweeting the panel of Elections and Nonresponse now here at #AAPOR
First is Cameron McPhee (SSRS) presenting Underestimation or Overcorrection? an Evaluation of Weighting and Likely-Voter Identification in 2022 Pre-Election Polls Image
2022 Election Polls did really well, with maybe some under-estimation of Democrats Image
Read 40 tweets
May 12
Live tweeting Methods and Election Polling at #AAPOR here
First is Mike Witherly presenting The Effect of Random Ballot Order in the 2018 and 2022 City of Vancouver Municipal Elections Image
Vancouver municipal elections:
Rare instance of down ballot races
Read 40 tweets
May 11
Live tweeting the "Gridded Population Surveys" at #AAPOR
First is Dana Thomson (U of Twente) giving an introduction to gridded population sampling Image
Gridded population datasets publicly available
Not all are equal Image
Read 43 tweets
May 10
Tweeting now session "Come In and Stay a While: Recruiting and Measuring Attrition" at #AAPOR
Kyle (SSRS) starts the session talking about chronic-nonrespondents in the SSRS probability panel Image
Defining chronic nonrespondents -- people who have not responded the survey after at least six invitation. Image
Read 40 tweets
May 10
Phillip Hastings (PRAMS) talks about maximum nonresponse bias in PRAMS. Seeing @rrandridge as one of the co-authors, I'm expecting to see some Pattern-Mixture Modelling and maybe even some SMUB or SMAB metrics. Image
Oh yeah, we have some Proxy Pattern-Mixture Models and some sensitivity analysisbright at the 3rd slide! My favorite approach to deal with Missing Not at Random!
For more about Proxy Pattern-Mixture Model, I recommend the excellent paper by Andrige and Little (2011): scb.se/contentassets/…
Read 10 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(