Limited Dependent Variable Models in Panel Data
2026-07-29
The linear panel model eliminates \mu_i via the Within transformation:
\tilde{y}_{it} = \tilde{x}'_{it}\beta + \tilde{v}_{it}
This works because demeaning is a linear operation — \mu_i cancels exactly.
The nonlinear panel model with binary, count, censored, or ordered y_{it}:
\Pr[y_{it} = 1 \mid x_{it}, \mu_i] = F(x'_{it}\beta + \mu_i)
F(\cdot) is nonlinear \Rightarrow \mu_i cannot be swept out algebraically.
Three consequences:
A latent continuous y^*_{it} underlies all limited dependent variable models:
y^*_{it} = x'_{it}\beta + \mu_i + v_{it}
Different observability rules generate different model families:
| Outcome Type | Observability Rule | Example |
|---|---|---|
| Binary choice | y_{it} = \mathbf{1}[y^*_{it} > 0] | Employment |
| Ordered | y_{it} = j if \kappa_{j-1} < y^*_{it} \leq \kappa_j | Terror scale |
| Censored (Tobit) | y_{it} = \max(0,\, y^*_{it}) | Hours worked |
| Truncated | y_{it} = y^*_{it} if y^*_{it} > 0 | Positive wages |
| Count | \lambda_{it} = \exp(x'_{it}\beta + \mu_i) | Patents, arrests |
Three dimensions determine which estimator to use:
Axis 1 — Outcome type: Binary \to Ordered \to Count \to Censored / Truncated
Axis 2 — Effect treatment: Fixed effects (FE) \to Random effects (RE) \to Correlated RE (Mundlak/Chamberlain)
Axis 3 — Temporal structure: Static \to Observation-driven Markov \to Parameter-driven state space
After heterogeneity, we will have a dynamics taxonomy; at the end, there is a complete decision flowchart.
Setting: N individuals, T periods, individual effects \{\mu_1,\ldots,\mu_N\} unknown.
As N \to \infty with T fixed, the number of nuisance parameters grows at the same rate as the sample — the MLE for (\beta, \mu_1,\ldots,\mu_N) is inconsistent for \beta.
Why it does not arise in the linear model:
The Within estimator eliminates \mu_i exactly before estimation. The MLE of \beta and \{\mu_i\} are asymptotically independent in the linear case (Hsiao 2003).
Why it arises in nonlinear models:
Each \hat{\mu}_i is estimated from only T observations. Inconsistency in \hat{\mu}_i is transmitted to \hat{\beta} because the nonlinear information matrix is not block-diagonal between \beta and \{\mu_i\}.
For fixed effects logit as N \to \infty with T fixed:
| T | Asymptotic bias in \hat{\beta}_{MLE} | Direction |
|---|---|---|
| 2 | \hat{\beta}_{MLE} \xrightarrow{p} 2\beta | Away from zero |
| 10 | \approx 16\% | Away from zero |
| 20 | \approx 6.9\% | Away from zero |
Sources: Hsiao (2003); Greene (2004a)
Strategy 1 — Condition out \mu_i (FE approach)
Find a sufficient statistic S_i for \mu_i; condition the likelihood on S_i. \mu_i is eliminated without being estimated. \to Exact for logit (Chamberlain 1980) and Poisson (Hausman et al. 1984). \to Not available for probit or Tobit in general.
Strategy 2 — Integrate out \mu_i (RE approach)
Assume \mu_i \sim F(\sigma_\mu^2); replace \mu_i by integrating over its distribution. \to Consistent if distribution correctly specified; correlated RE (Mundlak) relaxes independence.
Strategy 3 — Model and correct the bias (Modified MLE)
Reduce bias from O(1/T) to O(1/T^2) via jackknife or analytic correction. \to Carro (2007); Hahn & Newey (2004); especially useful for dynamic models.
In static models the IPP involves only \beta and \{\mu_i\}.
In dynamic models with y_{i,t-1} as a regressor:
\Pr[y_{it} = 1 \mid x_{it}, y_{i,t-1}, \mu_i] = F(x'_{it}\beta + \gamma y_{i,t-1} + \mu_i)
Why it is worse dynamically:
The initial conditions problem: y_{i0} is typically not exogenous. Ignoring this biases estimates of \gamma (state dependence) and compounds the IPP bias. \to We will address dynamic complications systematically after heterogeneity.
Key result (Chamberlain 1980): For the fixed effects logit, S_i = \sum_{t=1}^T y_{it} is a minimal sufficient statistic for \mu_i.
Conditional on S_i, the joint distribution of (y_{i1},\ldots,y_{iT}) does not depend on \mu_i.
L_c(\beta) = \prod_{i=1}^N \Pr\!\left(y_{i1},\ldots,y_{iT} \;\Big|\; \sum_{t=1}^T y_{it}\right)
Maximising L_c gives the CMLE — consistent and asymptotically normal as N \to \infty for fixed T. No incidental parameters problem.
For T = 2, conditioning on y_{i1} + y_{i2} = 1 (only “switchers” contribute):
\Pr[y_{i1}=1, y_{i2}=0 \mid y_{i1}+y_{i2}=1] = \frac{1}{1 + e^{(x_{i2}-x_{i1})'\beta}}
\Pr[y_{i1}=0, y_{i2}=1 \mid y_{i1}+y_{i2}=1] = \frac{1}{1 + e^{(x_{i1}-x_{i2})'\beta}}
Key observations:
For T > 2: \sum_t y_{it} can be 0,1,\ldots,T. Observations with \sum_t y_{it} \in \{0,T\} contribute nothing. Conditional probabilities computed recursively — implemented in xtlogit, fe and clogit.
Manski’s (1987) maximum score estimator: Semiparametric alternative when the logistic assumption is too strong:
\max_\beta \; \frac{1}{n} \sum_{i=1}^n z_i \cdot \text{sgn}(x'_i \beta), \quad z_i = 2y_i - 1
Maximises correct predictions; no likelihood assumed.
Limitations: Convergence rate N^{1/3} not \sqrt{N}; no information-matrix standard errors — bootstrap required.
H_0: No individual effects — pooled logit is consistent and efficient.
Under H_1: CMLE is consistent; pooled MLE is not.
m = (\hat{\beta}_{CML} - \hat{\beta}_{MLE})' \left[\widehat{V}_{CML} - \widehat{V}_{MLE}\right]^{-1} (\hat{\beta}_{CML} - \hat{\beta}_{MLE}) \;\sim\; \chi^2_K
under H_0.
Practical note: CMLE discards non-switchers so it is less efficient under H_0. The test asks: is the efficiency cost worth the bias protection under H_1? An alternative: use the Mundlak test in xtprobit
Honoré & Lewbel (2002): Chamberlain’s negative identification result can be overturned if at least one continuous “special regressor” is independent of \mu_i. Allows \sqrt{N}-consistent semiparametric estimation without the logistic assumption.
Magnac (2004): \sum_t y_{it} is a sufficient statistic under necessary and sufficient conditions strictly weaker than the logit model — the result generalises beyond logit to the “odds ratio” restriction.
Honoré & Tamer (2006): When point identification fails, bounds on \beta can be constructed. The identified set is often informatively small in practice — useful when exact point identification requires implausible assumptions.
For RE probit, u_{it} = \mu_i + v_{it}, where \mu_i \sim \text{IIN}(0,\sigma_\mu^2), v_{it} \sim \text{IIN}(0,1).
The individual likelihood is a T-dimensional integral — infeasible for large T.
Conditioning on \mu_i makes the v_{it} independent, reducing to a single integral:
L_i = \int \left[\prod_{t=1}^T \Phi\!\left(q_{it}(x'_{it}\beta + \mu_i)\right)\right] \phi\!\left(\frac{\mu_i}{\sigma_\mu}\right) \frac{d\mu_i}{\sigma_\mu}
where q_{it} = 2y_{it} - 1 and \Phi is the standard normal CDF.
The single remaining integral is approximated by Gauss–Hermite quadrature:
\ln L_h = \sum_{i=1}^N \ln\!\left[\frac{1}{\sqrt{\pi}} \sum_{h=1}^H w_h \prod_{t=1}^T \Phi\!\left(q_{it}(x'_{it}\beta + \theta z_h)\right)\right]
where \theta = \sigma_\mu\sqrt{2}, and w_h, z_h are quadrature weights and nodes.
lme4 (R)Problem with basic RE probit: Assumes \mu_i \perp x_{it} — often unrealistic.
Mundlak (1978) device: Let \mu_i = \bar{x}'_i \delta + \varepsilon_i where \bar{x}_i = T^{-1}\sum_t x_{it}.
\Pr[y_{it} = 1 \mid x_{it}, \bar{x}_i] = \Phi\!\left((1+\sigma_\varepsilon^2)^{-1/2}(x'_{it}\beta + \bar{x}'_i \delta)\right)
Consistent even when \mu_i is correlated with x_{it}. Implement by adding \bar{x}_i as regressors to xtprobit.
Chamberlain (1984) extension: \mu_i = x'_{i1}a_1 + \cdots + x'_{iT}a_T + \varepsilon_i — more flexible but uses TK additional parameters.
Test: H_0: \delta = 0 in Mundlak specification tests whether RE assumption is valid.
FE Conditional Logit
RE Probit (Mundlak)
Practical recommendation: Use correlated RE probit (Mundlak device) as the default. Report FE logit as a robustness check. Test H_0: \delta = 0 to guide the choice.
Observable y_{it} \in \{1,2,\ldots,J\} generated by threshold-crossing of y^*_{it}:
y_{it} = j \iff \kappa_{j-1} < y^*_{it} \leq \kappa_j, \quad -\infty = \kappa_0 < \kappa_1 < \cdots < \kappa_J = +\infty
With panel structure: y^*_{it} = x'_{it}\beta + \mu_i + v_{it}
\Pr[y_{it} = j \mid x_{it}, \mu_i] = F(\kappa_j - x'_{it}\beta - \mu_i) - F(\kappa_{j-1} - x'_{it}\beta - \mu_i)
The panel complication: \mu_i shifts the entire probability distribution — the same incidental parameters problem as in binary choice, but across J categories.
No sufficient statistic for \mu_i in general for J > 2 — hence no FE ordered probit analogous to FE logit.
Direct extension of RE Probit: \mu_i \sim \text{IIN}(0,\sigma_\mu^2) independent of v_{it} \sim \text{IIN}(0,1).
The individual likelihood involves the same single integral as RE probit — Butler–Moffitt quadrature applies directly.
Stata: xtoprobit y x1 x2, intpoints(24)
R: ordinal::clmm(ordered(y) ~ x1 + x2 + (1|id), link = "probit")
Correlated RE (Mundlak device): Add \bar{x}_i as regressors to allow \text{Corr}(\mu_i, x_{it}) \neq 0.
Post-estimation: margins / marginaleffects for category-specific average partial effects.
Problem: No general sufficient statistic for \mu_i in the ordered logit with J > 2.
Baetschmann, Staub & Winkelmann (2015) — “Blow-Up and Cluster” (BUC):
Stata: ssc install buc then buc y x1 x2, group(id) vce(cluster id)
R: bife::bife() for each binary collapse, then stack and cluster
The parallel regression assumption: Same \beta governs all thresholds j. Often violated.
Generalised ordered logit: Allow \beta to vary across thresholds:
\Pr[y_{it} > j \mid x_{it}] = F(x'_{it}\beta_j), \quad j = 1,\ldots,J-1
Stata: gologit2 (Williams 2006) — partial proportionality available (pl() option)
R: VGAM::vglm(y ~ x, family = cumulative(parallel = FALSE))
Testing: Brant test in Stata (brant after ologit); LR test comparing constrained vs unconstrained models.
Panel extension: xtgologit2 (community SSC) for RE generalised ordered probit; Mundlak device as workaround for FE.
Panel count outcomes: patents, doctor visits, arrests, protest events, conflict incidents.
The natural model — Poisson with E[y_{it} \mid x_{it}, \mu_i] = \exp(x'_{it}\beta + \mu_i) — faces three complications:
But: The FE Poisson model has a unique property that exempts it from the incidental parameters problem — the most important positive result in this chapter.
Hausman, Hall & Griliches (1984): S_i = \sum_{t=1}^T y_{it} is a sufficient statistic for \mu_i in the Poisson model — and, uniquely, there is no incidental parameters problem.
The conditional likelihood reduces to a multinomial likelihood depending only on \beta:
\Pr\!\left[y_{it} \;\Big|\; \sum_t y_{it}\right] \;\propto\; \prod_t \left(\frac{\exp(x'_{it}\beta)}{\sum_s \exp(x'_{is}\beta)}\right)^{y_{it}}
Wooldridge (1999) QMLE: FE Poisson is consistent even if the count distribution is misspecified, provided E[y_{it} \mid \mu_i, x_{it}] = \exp(x'_{it}\beta + \mu_i) holds. Only the conditional mean needs to be correctly specified.
Stata: xtpoisson y x1 x2, fe vce(cluster id)
R: fixest::fepois(y ~ x1 + x2 | id, vcov = ~ id, data = df)
Overdispersion (\text{Var}[y_{it}] > E[y_{it}]) is nearly universal in practice.
Approach 1 — RE Negative Binomial (HHG 1984): Assume \exp(\mu_i) \sim \text{Gamma}(\alpha,\alpha). Integrating out \mu_i gives the NB marginal distribution. Stata: xtnbreg, re
Approach 2 — Robust FE Poisson (recommended): Use FE Poisson QMLE with robust standard errors. Overdispersion inflates SE but does not bias \hat{\beta}. Stata: xtpoisson, fe vce(cluster id)
Warning on xtnbreg, fe: The FE NB in Stata absorbs \mu_i through the overdispersion parameter (not the mean) — Allison & Waterman (2002) showed this does NOT fully control for time-invariant heterogeneity. Use with caution; prefer robust FE Poisson.
RE Poisson with Normal mixing: \mu_i \sim \text{Normal}(0,\sigma_\mu^2) — requires quadrature. Stata: xtpoisson, re (Normal mixing) or xtpoisson, gamma (Gamma mixing)
Specification tests:
| Test | Command (Stata) | H_0 |
|---|---|---|
| Random effects | xttest0 after xtpoisson, re |
\sigma_\mu^2 = 0 |
| Overdispersion | LR: xtpoisson, re vs xtnbreg, re |
No extra dispersion |
| FE vs RE | hausman fe re |
E[\mu_i \mid x_{it}] = 0 |
| Serial correlation | xtserial (SSC) |
No serial correlation |
Pre-sample mean proxy (Blundell, Griffith & Windmeijer 2002): Include \log(\bar{y}_{i,\text{pre}}) as offset or regressor — a practical proxy for \mu_i that avoids conditioning on \sum_t y_{it}.
Zero-inflated Poisson (ZIP): Two-part model — probability \pi of structural zero + Poisson count. For panel data: zip with vce(cluster id) in Stata; community-contributed xtzip.
Hurdle model: Separate binary participation equation + truncated count equation (positive counts only). More interpretable than ZIP when zeros and positives have different determinants.
Blundell, Griffith & Windmeijer (2002) pre-sample mean: A practical dynamic proxy:
Testing dynamics: LR test comparing static vs dynamic Poisson; check residual ACF after xtpoisson, fe for remaining serial correlation.
Cox (1981) distinguishes two fundamental classes of dynamic models:
Observation-driven: The conditional distribution f(y_{it} \mid \mathcal{F}_{i,t-1}, x_{it}, \mu_i) depends on past outcomes directly through the filtration \mathcal{F}_{i,t-1} = \{y_{i,t-1}, y_{i,t-2}, \ldots\}. \to Likelihood is a product of closed-form one-period-ahead predictive densities. \to Examples: dynamic logit/probit, ordered Markov, INGARCH.
Parameter-driven: A latent process \alpha_{it} evolves by its own Markov law; y_{it} depends on \alpha_{it} and x_{it} but not directly on y_{i,t-1}. \to Likelihood requires integrating over the path of \alpha_{it} — computationally intensive. \to Examples: state space probit, dynamic factor models with discrete outcomes.
Heckman (1981c) distinguishes two reasons for persistence in panel outcomes:
True state dependence: The past outcome y_{i,t-1} causally changes future probabilities.
\Pr[y_{it} = 1 \mid x_{it}, y_{i,t-1}=1, \mu_i] > \Pr[y_{it} = 1 \mid x_{it}, y_{i,t-1}=0, \mu_i]
Spurious state dependence: Persistence driven by unobserved \mu_i that is stable over time — certain individuals always have high (or low) probabilities regardless of history.
Why it matters: True state dependence implies interventions should be early (to break the cycle). Spurious state dependence implies targeting the underlying heterogeneity.
Testing: \gamma \neq 0 in F(x'_{it}\beta + \gamma y_{i,t-1} + \mu_i), after controlling for \mu_i.
In any dynamic panel GLM, y_{i0} is typically not exogenous — it was generated by the same model containing \mu_i.
Three solutions, applicable across all outcome types:
| Approach | Method | Software |
|---|---|---|
| Heckman (1981b) | Reduced-form approximation for f(y_{i0} \mid x_i, \mu_i) | Custom code |
| Wooldridge (2005) | Model \mu_i \mid (y_{i0}, \bar{x}'_i) as normal; add y_{i0}, \bar{x}_i as regressors | Standard RE routines |
| Semiparametric | Condition on sufficient statistics (logit, Poisson) | clogit, xtpoisson, fe |
Practical recommendation: The Wooldridge (2005) device is the most versatile — it applies to binary, ordered, count, and Tobit models with minimal additional code.
The first-order Markov binary panel model:
\Pr[y_{it} = 1 \mid x_{it}, y_{i,t-1}, \mu_i] = F(x'_{it}\beta + \gamma y_{i,t-1} + \mu_i)
\gamma \neq 0 implies true state dependence (conditional on individual effects).
Key challenge: The incidental parameters problem gets worse — both \mu_i and the lagged outcome y_{i,t-1} create bias channels in the MLE.
Testing state dependence: An LR test of H_0: \gamma = 0 after properly controlling for \mu_i is the cleanest diagnostic. A Wald test also works.
Static model bias from ignoring dynamics: If \gamma \neq 0, omitting y_{i,t-1} from the static model causes omitted variable bias in \hat{\beta} (through the correlation of x_{it} with past outcomes).
Step-by-step implementation:
Step 1: Compute group means \bar{x}_i = T^{-1}\sum_t x_{it}
Step 2: Specify the conditional distribution of \mu_i:
\mu_i \mid y_{i0}, \bar{x}_i \;\sim\; \text{Normal}(\gamma_0 y_{i0} + \bar{x}'_i \delta, \sigma_a^2)
Step 3: Substitute and run standard RE probit with augmented regressors:
\Pr[y_{it}=1] = \Phi\!\left(\tilde{x}'_{it}\tilde{\beta} + \tilde{\gamma} y_{i,t-1} + \gamma_0 y_{i0} + \bar{x}'_i \delta\right)
For the dynamic FE logit model, the sufficient statistic argument does not directly extend because y_{i,t-1} is correlated with \mu_i.
Honoré & Kyriazidou (2000): Identification requires the strict exogeneity condition x'_{i2} = x'_{i3} for T = 3. Under this condition, a conditional likelihood is available that eliminates \mu_i.
Kernel weighting: Since x'_{i2} = x'_{i3} exactly is a zero-probability event with continuous x, kernel weights K\!\left(\frac{x_{i2}-x_{i3}}{h_N}\right) are applied.
Limitation: Convergence rate slower than \sqrt{N}; computationally intensive.
Practical guidance: For most applied datasets, the Wooldridge (2005) device is more practical.
Carro (2007): Modified MLE (MMLE) — corrects the concentrated loglikelihood to eliminate the first-order O(1/T) bias term. Performs well for T \geq 8.
| Panel length | Recommended estimator |
|---|---|
| T \leq 3 | Wooldridge (2005) device |
| T = 4–8 | Wooldridge (2005) or Carro (2007) |
| T > 8 | FE MLE with Carro bias correction, or Wooldridge |
Vella & Verbeek (1998) / Wooldridge (2005): PSID, 545 full-time male workers, 1980–87. Dynamic RE probit (Wooldridge device), average partial effects of state dependence:
| Sample | \hat{\gamma}_{\text{APE}} | Std. Error |
|---|---|---|
| Married men | 0.182 | (0.041) |
| Unmarried men | 0.173 | (0.052) |
Prior union membership increases \Pr[\text{union}] by \approx 18\% — true state dependence.
With binary outcomes: one lag y_{i,t-1} \in \{0,1\} — one parameter \gamma.
With J ordered categories, y_{i,t-1} can enter in three ways:
The transition matrix approach is the most general — it allows asymmetric persistence: escalation may differ from de-escalation, a key substantive question in conflict, repression, and disease progression research.
The ordered observation-driven Markov model:
\Pr[y_{it} \leq j \mid y_{i,t-1}, x_{it}, \mu_i] = F\!\left(\kappa_j - x'_{it}\beta - \sum_{k=1}^{J-1} \gamma_k \mathbf{1}[y_{i,t-1}=k] - \mu_i\right)
Estimands of interest:
The J \times J predicted transition matrix evaluated at covariate means gives the most interpretable summary of dynamic persistence.
Walker (2006, working paper): “Democracy and Human Rights Abuses: Insights from First-Order Markov Models”
Data: 1976–2003, country-year panel; six measures of human rights abuses including the Political Terror Scale (PTS, 1–5) and CIRI physical integrity index.
Key finding: The effect of political democracy on human rights abuses depends critically on the past level of repression. The \gamma_k parameters reveal:
Methodological contribution: A static ordered probit cannot recover this history-contingent relationship. The Markov structure is essential for the substantive finding.
Contoyannis, Jones & Rice (2004) apply the Wooldridge device to ordered outcomes — the canonical implementation.
Step-by-step:
xtoprobit with lagged category dummies + y_{i0} dummies + \bar{x}_iMüller, Raposo & Vandoros (2021): For T = 3, observations satisfying x'_{i2} = x'_{i3} yield a conditional likelihood that eliminates \mu_i from the dynamic ordered logit. No standard software implementation yet.
Testing state dependence: LR test: compare xtoprobit with vs. without lagged category dummies — \chi^2_{J-1} under H_0: \gamma_1 = \cdots = \gamma_{J-1} = 0
Testing asymmetric persistence: Wald test: H_0: \gamma_1 = \gamma_2 = \cdots = \gamma_{J-1}
Davis, Dunsmuir & Streett (2003) / Harvey & Fernandes (1989): The observation-driven INGARCH(1,1):
y_{it} \mid \mathcal{F}_{i,t-1} \sim \text{Poisson}(\lambda_{it}), \quad \lambda_{it} = \omega_i + \alpha y_{i,t-1} + \beta \lambda_{i,t-1}
Closed-form likelihood as a product of Poisson densities. Persistence: \alpha + \beta; stationary if \alpha + \beta < 1.
Creal, Koopman & Lucas (2013) GAS framework: Update \lambda_{it} via the scaled score:
\lambda_{it} = \omega + A \cdot s_{i,t-1} + B \cdot \lambda_{i,t-1}, \quad s_{it} = \nabla_{it} \cdot \mathcal{I}_{it}^{-1}
| Distribution | Score s_{it} | Model |
|---|---|---|
| Poisson | y_{it}/\lambda_{it} - 1 | INGARCH(1,1) |
| Negative Binomial | (y_{it} - \lambda_{it})/(\lambda_{it}(1 + \alpha^{-1}\lambda_{it})) | NB-GAS |
The pre-sample mean approach for dynamic count panel models:
\log \lambda_{it} = x'_{it}\beta + \gamma \log y_{i,t-1} + \log \bar{y}_{i,\text{pre}} + v_{it}
where \bar{y}_{i,\text{pre}} is the pre-sample mean count — a proxy for \exp(\mu_i).
Implementation in Stata:
In R with fixest:
Arellano-Bond GMM alternative (Windmeijer 2000): Instrument y_{i,t-1} with y_{i,t-2}, y_{i,t-3}, \ldots in first-differenced equations. Consistent under serial uncorrelation of v_{it}.
NB-INGARCH: Replace Poisson with NB in the INGARCH framework:
y_{it} \mid \mathcal{F}_{i,t-1} \sim \text{NB}(\lambda_{it}, \phi), \quad \lambda_{it} = \omega + \alpha y_{i,t-1} + \beta \lambda_{i,t-1}
Available via tscount::tsglm(distr = "nbinom") in R.
Dynamic hurdle models: For excess zeros with dynamics:
Testing dynamics:
xtpoisson, fe for remaining serial correlationFor a multinomial probit panel model with M alternatives and T periods, the choice probability involves a T(M-1)-dimensional integral:
\Pr[\mathbf{y}_i = \mathbf{j}] = \int_{\mathcal{A}_j} f(\boldsymbol{\varepsilon}_i)\, d\boldsymbol{\varepsilon}_i
where \mathcal{A}_j is a high-dimensional region and \boldsymbol{\varepsilon}_i \in \mathbb{R}^{T(M-1)}.
Step 1: Decompose the error covariance \Sigma = LL' (Cholesky decomposition).
Step 2: Express choice probabilities as a product of univariate conditional probabilities using the triangular structure of L.
Step 3: Draw antithetic samples \eta^{(r)} \sim \text{Normal}(0, I), r = 1, \ldots, R.
Step 4: Compute simulated probability:
\hat{P}_{ij} = \frac{1}{R}\sum_{r=1}^R \prod_{t=1}^T \Phi\!\left(\frac{u_{it}^{(r)} - \ell'_{it}\eta^{(r)}_{<t}}{\ell_{tt}}\right)
Simulated MLE: \max_\theta \sum_i \log \hat{P}_{iy_i}(\theta) — consistent as R, N \to \infty; bias O(1/R).
Practical rule of thumb: R \geq 10\sqrt{N} draws (Hajivassiliou & Ruud 1994). For N = 1000, R \geq 316 draws — feasible on modern hardware.
When to prefer MSM (Keane 1994):
When to prefer simulated MLE:
Software: Stata asmprobit and asroprobit; R mlogit::mlogit() with probit = TRUE; custom GHK implementation for complex models.
Standard Tobit: y^*_{it} = x'_{it}\beta + \mu_i + v_{it}, v_{it} \sim \text{IIN}(0, \sigma_v^2)
Observed: y_{it} = \max(0, y^*_{it}) — hours worked, expenditure, donations.
Heckman & MaCurdy (1980): Fixed effects Tobit with life-cycle motivation. FE Tobit MLE maximises \sum_i \ln L_i(\beta, \mu_i, \sigma_v) simultaneously — suffers from the incidental parameters problem.
Random effects Tobit: Assume \mu_i \sim \text{IIN}(0, \sigma_\mu^2); Butler-Moffitt quadrature applies:
L_i = \int \prod_t \left[\Phi\!\left(\frac{x'_{it}\beta + \mu_i}{\sigma_v}\right)^{1-y_{it}}\phi\!\left(\frac{y_{it} - x'_{it}\beta - \mu_i}{\sigma_v}\right)^{y_{it}/\sigma_v}\right] \phi\!\left(\frac{\mu_i}{\sigma_\mu}\right) \frac{d\mu_i}{\sigma_\mu}
Stata: xttobit y x1 x2 (RE only; no built-in FE Tobit)
Greene (2004a,b): The FE Tobit bias is approximately equal to the censoring fraction:
| Censoring | FE Tobit MLE | Honoré LAD |
|---|---|---|
| < 20\% | Acceptable bias | May be overkill |
| 20\%–40\% | Noticeable bias | Recommended |
| > 40\% | Severe bias | Essential |
Honoré (1992) Trimmed LAD: Exploit symmetry of y^*_{it} around x'_{it}\beta + \mu_i to construct moment conditions free of \mu_i.
\beta_{LAD} = \argmin_\beta \sum_{i}\sum_{t>s} \left[|y_{it} - y_{is} - (x_{it}-x_{is})'\beta| - \text{trim}(\cdot)\right]
ssc install honor; then honor y x1 x2, model(tobit) ll(0) group(id)Honoré (1993) Dynamic Tobit: Adds y_{i,t-1} to the Tobit model:
y^*_{it} = x'_{it}\beta + \lambda y_{i,t-1} + \mu_i + v_{it}, \quad y_{it} = \max(0, y^*_{it})
Exploits symmetry conditions on v_{it} to construct GMM estimators free of \mu_i.
Kyriazidou (1997) Type 2 Tobit (sample selection model):
y^*_{1it} = x'_{1it}\beta_1 + \mu_{1i} + v_{1it} \quad \text{(selection)} y^*_{2it} = x'_{2it}\beta_2 + \mu_{2i} + v_{2it} \quad \text{(outcome, observed when } y_{1it}=1)
First-differencing eliminates \mu_{2i}; kernel weights handle selection. → Applied to nurses data.
Panel surveys are repeated cross-sections — individuals who drop out are permanently lost.
Two types of missing data:
Panel-specific sources of nonignorable attrition: health deterioration, geographic mobility, survey fatigue, institution-level attrition (firm closure, country exit).
Testing ignorability: Verbeek & Nijman (1992a): include attrition-related variables (s_{it-1}, \prod_t s_{it}, T_i) as regressors — significant coefficients suggest nonignorable selection.
Cross-section Heckman (1979): One selectivity correction term (inverse Mills ratio \lambda(\cdot)).
Panel extension (Verbeek & Nijman 1992b): Following Hausman & Wise (1979):
E[y_{it} \mid x_{it}, \mu_i, r_{it}=1] = x'_{it}\beta + \mu_i + \sigma_{\mu\varepsilon}\lambda_{\mu}(\cdot) + \sigma_{\eta v}\lambda_{\eta}(\cdot)
Two selectivity correction terms:
Both require numerical integration — a significant computational burden vs. the cross-section case.
Wooldridge (1995) variable addition test:
Verbeek & Nijman (1992a) four-estimator Hausman tests:
Let \hat{\delta} = (\tilde{\beta}_W(B),\; \tilde{\beta}_W(U),\; \tilde{\beta}_{GLS}(B),\; \tilde{\beta}_{GLS}(U)) where B = balanced subpanel, U = full panel.
Test contrasts (R_1–R_4) compare Within vs GLS estimators across balanced and unbalanced subpanels — all should agree under ignorable selection.
Askildsen, Baltagi & Holmås (2003): Do wages raise female labour supply among nurses?
Data: 19,638 Norwegian female nurses, 1993–98; six-year matched panel; 69,122 observations.
Three simultaneous challenges:
Estimation strategy (Kyriazidou 1997):
Conditional logit estimates (Table 11.1 — selected coefficients):
| Variable | Estimate | Std. Error |
|---|---|---|
| Educated nursing specialist | 0.616** | (0.069) |
| Age | 0.113** | (0.034) |
| Age^2 | −0.004** | (0.000) |
| Number of children | −0.264** | (0.046) |
| Children < 3 years | −0.142** | (0.042) |
| Disable | −1.268** | (0.224) |
| Hospital in municipality | 0.646** | (0.062) |
| Participation rate (local) | 0.035** | (0.007) |
** Significant at 1%; * at 5%. Log-likelihood = -22{,}287.46; N = 61{,}464.
Kyriazidou (1997) IV estimates (Table 11.2 — selected coefficients):
| Variable | Estimate | Std. Error |
|---|---|---|
| Ln wage | 0.208* | (0.094) |
| Shift work | −0.011** | (0.001) |
| Hour 35.5 contract | −0.040** | (0.005) |
| Disabled | −0.258** | (0.026) |
| Single | 0.021** | (0.004) |
| Children < 3 years | −0.050** | (0.003) |
** Significant at 1%; * at 5%. N = 121{,}622. Wage elasticity = 0.21 after corrections.
Methodological lesson: The panel structure is essential — simultaneous FE, selection correction, and IV are only feasible with repeated observations of the same individuals.
| Model | FE Estimator | RE Estimator |
|---|---|---|
| Binary logit | xtlogit, fe / clogit |
xtlogit, re |
| Binary probit | — (no FE probit) | xtprobit, re |
| Ordered logit/probit | buc (SSC) |
xtoprobit |
| Poisson count | xtpoisson, fe |
xtpoisson, re |
| Negative binomial | xtnbreg, fe* |
xtnbreg, re |
| Tobit (censored) | — (use Honoré) | xttobit |
| Sample selection | Kyriazidou honor |
Heckman + panel |
*Use with caution — as explained in Panel Count Models
R: fixest::feglm(), pglm::pglm(), lme4::glmer(), ordinal::clmm(), fixest::fepois()
Fixed effects (conditional logit):
Random effects probit with Mundlak device:
Post-estimation average partial effects:
Fixed effects conditional logit:
Random effects probit with Mundlak device:
Average partial effects:
Stata — RE ordered probit:
Stata — FE ordered logit (BUC):
Stata — FE Poisson (recommended default):
Stata — RE Poisson with overdispersion test:
RE Tobit (Stata):
Honoré (1992) FE Tobit (Stata):
RE Tobit (R):
Step 1 — Test for individual effects:
Step 2 — Test for serial correlation:
Step 3 — Test for selection (if unbalanced):
Common pitfalls:
xtnbreg, fe without understanding the Allison-Waterman caveatxttobit when censoring fraction is high (> 30\%)Step 1 — What type of outcome?
Binary → Blocks 2/3/6A | Ordered → Blocks 4/6B | Count → Blocks 5/6C | Censored → Block 8 | Selection → Block 9
Step 2 — FE or RE?
Run Mundlak test (test xbar1 xbar2 ...). Reject H_0 → Use FE (or correlated RE) | Fail to reject → RE sufficient
Step 3 — Is there temporal dependence?
Run serial correlation test (xtserial / pbgtest). Reject H_0 → Add lagged outcome; address initial conditions (Wooldridge 2005 device)
Step 4 — Is the panel balanced?
Unbalanced → Test ignorability of attrition (Wooldridge 1995 variable addition test). Reject → Full selection correction (Block 9)
Step 5 — Report average partial effects, not raw coefficients. Use margins / marginaleffects.
Partial identification in FE models: Honoré & Tamer (2006) provide informative bounds on \beta when point identification fails in FE binary choice. Extension to ordered and dynamic cases (Müller et al. 2021) is active research.
Machine learning and high-dimensional fixed effects: fixest handles millions of observations and thousands of fixed effects. Current research explores regularisation (LASSO, ridge) for selecting controls while maintaining consistent \hat{\beta} in panel GLMs.
Bayesian panel GLMs: Hasegawa (2009) — Bayesian dynamic ordered probit via MCMC. Schnakenberg & Fariss (2014) — dynamic ordinal IRT. Particularly valuable for short panels (T \leq 4) where frequentist FE methods discard too much information.
Non-rectangular panels and multiple imputation: Multiple imputation for missing panel data (Rubin 1987 extended to panel settings); pattern mixture models for MNAR data.
Textbook foundations:
Incidental parameters: theory and Monte Carlo:
Fixed effects binary choice:
Random effects binary choice:
Ordered outcomes in panel data:
Panel count models:
Dynamics — foundational papers:
Dynamic binary panel models:
Dynamic ordered panel models and human rights applications:
Dynamic count models:
tscount R package: CRANSimulation estimation methods:
Censored and truncated panel data:
Selection bias and attrition in panels:
Nurses’ labour supply and related applications:
Software documentation and packages:
xtlogit, xtprobit, xtpoisson, xtnbreg, xttobit, xtoprobit — Stata 18 Longitudinal/Panel Data Reference Manual. stata.comfixest: Bergé, L. (2018). Efficient estimation of maximum likelihood models with multiple fixed-effects. Econometrics Journal, 21(3), 388–408. doi:10.1111/ectj.12101 | Packagelme4: Bates et al. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1). doi:10.18637/jss.v067.i01 | Packageordinal: Christensen, R.H.B. (2019). ordinal — Regression models for ordinal data. Packagepglm: Croissant, Y. (2020). pglm: Panel generalised linear models. Packagemarginaleffects: Arel-Bundock et al. (2024). Journal of Statistical Software, 111(9). doi:10.18637/jss.v111.i09 | Websitetscount: Liboschik et al. (2017). tscount: An R package for analysis of count time series following generalized linear models. Journal of Statistical Software, 82(5). doi:10.18637/jss.v082.i05 | PackagecensReg: Henningsen, A. (2010). Estimating censored regression models in R using the censReg package. PackageclubSandwich: Pustejovsky, J.E. (2015). Cluster-robust variance estimation. Packagessc install buc in Stata; code accompanying Baetschmann et al. (2015)ssc install honor in Stata; author’s pageFrontiers and synthesis:

ESSSSDA26-2J: Panel GLM