Profile picture
Kristen Olson @olson_km
, 9 tweets, 4 min read Read on Twitter
#JSM2018 Standing room only for this session. With Jorg Dreschler, Raghu, Rod Little, and Don Rubin as presenters, easy to understand why
#JSM2018 Jorg Dreschler up first. Classification systems for industries change frequently, no consistent coding over time. Treat problem as missing data problem.
#JSM2018 Dreschler Has Establishment History Panel from all establishments in Germany with 1+ employee covered by social security. Lots of data on each establishment. 4 different classification systems in use. Two systems are jointly observed in one year.
#JSM2018 Dreschler 95% of the work went into data preparation, but the audience doesn’t find that interesting in a talk.
#JSM2018 Dreschler Had imputation by extrapolation, then deterministic imputation, then probabilistic imputation. Imputed years sequentially, using adjacent coding systems and adjacent years.
#JSM2018 Probabilistic imputation using CART used b/c parametric imputation explodes for categorical variables.
#JSM2018 Dreschler The overview - grow large trees for the imputation; can’t fit one tree to the entire dataset. Run separate CART models by industry code so that each block has up to 20 industry category
#JSM2018 Dreschler Compares CART approach with 2 methods used previously at IAB and in the LEHD. Use difference in cell size between imputated and original data. Marginal distribution of overall industry category similar
#JSM2018 Dreschler detailed Industry codes worst for deterministic approach. Some industries never selected for being imputed - imputing the mode doesn’t work. Probabilistic and CART imputation better reflects distributions.
Missing some Tweet in this thread?
You can try to force a refresh.

Like this thread? Get email updates or save it to PDF!

Subscribe to Kristen Olson
Profile picture

Get real-time email alerts when new unrolls are available from this author!

This content may be removed anytime!

Twitter may remove this content at anytime, convert it as a PDF, save and print for later use!

Try unrolling a thread yourself!

how to unroll video

1) Follow Thread Reader App on Twitter so you can easily mention us!

2) Go to a Twitter thread (series of Tweets by the same owner) and mention us with a keyword "unroll" @threadreaderapp unroll

You can practice here first or read more on our help page!

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member and get exclusive features!

Premium member ($3.00/month or $30.00/year)

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!