In such cases, we have a clear tradeoff between consistency and efficiency.
In models additive in endogenous explanatory variables with constant coefficients, CF reduces to 2SLS or FE2SLS -- which is neat. Of course, the proof uses Frisch-Waugh.
The equivalence between CF and 2SLS implies a simple, robust specification test of the null that the EEVs are actually exogenous. One can use "robust" or Newey-West or "cluster robust" very easily. The usual Hausman test is not robust, and suffers from degeneracies.
In addition, that CF = 2SLS nicely highlights the pretesting problem in deciding between OLS and 2SLS: leave the CF in the regression and its 2SLS. Drop it and we do OLS. The pretesting problem is compounded by the CF being a "generated regressor" from the first stage.
Here is the basic approach. Start with w (scalare) potentially endogenous in
y = a + b*w + x*g + u
The linear projection first stage is
w = f + x*d + z*h + v
The error v is the control function. We estimate it by OLS on the first stage and obtain the residuals, vh.
Second stage: Run the regression
y on 1, w x, vh
Coefficients on 1, w, x are all 2SLS. Adding vh controls for the endogeneity of w. A robust (as you want) t statistic on vh tests Ho: w is exogenous.
This method is all based on LPs. It works for discrete w without change.
If the coefficient on v in projecting u onto v is not zero (w is endogenous), the standard errors for the CF approach are not valid. Because it's 2SLS, go back to 2SLS software. One could bootstrap both steps, and that's useful for more complicated settings.
• • •
Missing some Tweet in this thread? You can try to
force a refresh
I think frequentists and Bayesians are not yet on the same page, and it has little to do with philosophy. It seems some Bayesians think a proper response to clustering standard errors is to specify an HLM. But in the linear case, HLM leads to GLS, not OLS.
Moreover, a Bayesian would take the HLM structure seriously in all respects: variance and correlation structure and distribution. I'm happy to use an HLM to improve efficiency over pooled estimation, but I would cluster my standard errors, anyway. A Bayesian would not.
There still seems to be a general confusion that fully specifying everything and using a GLS or joint MLE is a costless alternative to pooled methods that use few assumptions. And the Bayesian approach is particular unfair to pooled methods.
If you teach prob/stats to first-year PhD students, and you want to prepare them to really understand regression, go light on measure theory, counting, combinatorics, distributions. Emphasize conditional expectations, linear projections, convergence results.
@metricstotheface.
This means, of course, law of iterated expectations, law of total variance, best MSE properties of CEs and LPs. How to manipulate Op(1) and op(1). Slutsky's theorem. Convergence in distribution. Asymptotic equivalence lemma. And as much matrix algebra as I know.
If you're like me -- and barely understand basic combinatorics -- you'll also be happier. I get the birthday problem and examples of the law of very large numbers -- and that's about it.
When I teach regression with time series I emphasize that even if we use GLS (say, Prais-Winsten), we should make standard errors robust to serial correlation (and heteroskedasticity). Just like with weighted least squares.
I like the phrase "quasi-GLS" to emphasize, in all contexts, we shouldn't take our imposed structure literally. In Stata, it would be nice to allow this:
prais y x1 x2 ... xK, vce(hac nw 4)
vce(robust) is allowed, but it's not enough. The above would be easy to add.
To its credit, Stata does allow
reg y x1 ... xK [aweight = 1/hhat], vce(robust)
to allow our model of heteroskedasticity, as captured by hhat, to be wrong. I've pushed this view in my introductory econometrics book.
what are the relative merits of usual 2SLS, with a linear first stage for w, versus using a probit for w and then using probit fitted values as IVs in the second stage?
Both are consistent under standard identification assumptions. Using a probit first stage could be more efficient. Those are the optimal IVs if (1) Var(u|x,z) is constant and (2) P(w = 1|x,z) = probit. It's consistent without either assumption, just like 2SLS.
As shown by my former student Ruonan Xu, the probit first stage can help with a weak IV problem:
A bit more on clustering. If you observe the entire population and assignment is at the unit level, there is not need to cluster. If assignment is at the group level -- to all units -- cluster at the group level. (Hopefully there are many groups.)
I've used the term "ex-post clustering" to describe obsession with clustering just to do it. You don't cluster individual data at the county, state, or regional level just for the heck of it. One must take a stand on the sampling and assignment schemes.
It's easy to see with formulas for estimating the mean from a population. The clustered standard error is too large because of heterogeneity in the means across groups for cluster correlation.