Lihua Lei Profile picture
Feb 14 6 tweets 3 min read
A thread on BUE & BLUE🔥

Gauss-Markov condition:
1) y=Xβ+ε
2) E[ε|X]=0
3) Cov(ε|X)=σ^2Σ

Standard GM:
4) Σ=I

The GM thm shows that OLS/GLS is BL(inear)UE.

Hansen (’20) shows it holds for all unbiased est (inc. nonlinear) w/ an elegant proof (tilted density + Cramer-Rao)

1/n
Call F_2 & F_2^0 the classes of dists satisfying 1-3 & 1-4.
Hansen proves if \hat{β} is unbiased under F_2 for all Σ, then GLS (OLS) is BUE under F_2 (F_2^0).

An intriguing Q. raised by @jmwooldridge & @CavaliereGiu is

Does there exist nonlinear unbiased est under F_2?

2/n Image
Turns out no nonlinear est can be unbiased under F_2!

This can be proved using a deep result by Koopmann (’82) and restated in Gnot et al. (’92)

tandfonline.com/doi/abs/10.108…

Roughly speaking, an estimator that is unbiased under F_2 w/ a fixed Σ must be linear+quadratic.

3/n Image
Specifically, an unbiased estimator under F_2 w/ a fixed Σ must be

Ay+(y’H_1y,…,y’H_py), tr(H_i Σ)=0, X’H_i X=0

Thus, if it is unbiased under F_2, tr(H_i Σ)=0 for any Σ. Since {Σ: Σ∈F_2} spans R^{n^2}, H_i must be 0.

Therefore, only linear est can be unbiased under F_2

4/n
This implies F_2 rules out all nonlinear unbiased est while Koopmann (’82) implies F_2^0 can’t.

A follow-up Q. is: what is the smallest class F that rules out all nonlinear unbiased est?

As above, F does if {Σ: Σ∈F} spans R^{n^2}. Two practically relevant special cases👇

5/n
Case 1 (slightly heteroscedastic class): F={(1)+(2)+(3) with Var(ε_i)∈[σ^2±0.01]}

Case 2 (slightly serially correlated): F={(1)+(2)+(3) with Var(ε_i)=σ^2 & Cov(ε_i, ε_j)∈[a,b]}

Then any estimator that is unbiased under F must be linear! And thus OLS/GLS are BUE!

6/n

• • •

Missing some Tweet in this thread? You can try to force a refresh
 

Keep Current with Lihua Lei

Lihua Lei Profile picture

Stay in touch and get notified when new unrolls are available from this author!

Read all threads

This Thread may be Removed Anytime!

PDF

Twitter may remove this content at anytime! Save it as PDF for later use!

Try unrolling a thread yourself!

how to unroll video
  1. Follow @ThreadReaderApp to mention us!

  2. From a Twitter thread mention us with a keyword "unroll"
@threadreaderapp unroll

Practice here first or read more on our help page!

More from @lihua_lei_stat

Mar 2
🚨Job talk thread🚨

Title: What Can *Conformal Inference* Offer to Statistics?

Slides: lihualei71.github.io/Job_Talk_Lihua…

Main points:
(1) Conformal Inference can be made applicable in many #stats problems
(2) There are lots of misconceptions about Conformal Inference
(3) Try it!

1/n Image
Conformal Inference was designed for generating prediction intervals with guaranteed coverage in standard #ML problems.

Nevertheless, it can be modified to be applicable in

✔️Causal inference
✔️Survival analysis
✔️Election night model
✔️Outlier detection
✔️Risk calibration

2/n Image
Misconceptions about conformal inference:

❌ Conformal intervals only have marginal coverage and tend to be wide
✔️ Conformal intervals w/ proper conformity scores achieve conditional coverage & efficiency (short length) if the model is correctly specified

3/n Image
Read 6 tweets

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3/month or $30/year) and get exclusive features!

Become Premium

Don't want to be a Premium member but still want to support us?

Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal

Or Donate anonymously using crypto!

Ethereum

0xfe58350B80634f60Fa6Dc149a72b4DFbc17D341E copy

Bitcoin

3ATGMxNzCUFzxpMCHL5sWSt4DVtS8UqXpi copy

Thank you for your support!

Follow Us on Twitter!

:(