Nonlinear Panel Data Models

Limited Dependent Variable Models in Panel Data

Robert W. Walker

2026-07-29

Motivation and Taxonomy

Why Standard Panel Estimators Fail

The linear panel model eliminates \mu_i via the Within transformation:

\tilde{y}_{it} = \tilde{x}'_{it}\beta + \tilde{v}_{it}

This works because demeaning is a linear operation — \mu_i cancels exactly.

The nonlinear panel model with binary, count, censored, or ordered y_{it}:

\Pr[y_{it} = 1 \mid x_{it}, \mu_i] = F(x'_{it}\beta + \mu_i)

F(\cdot) is nonlinear \Rightarrow \mu_i cannot be swept out algebraically.

Three consequences:

  • MLE of \beta is inconsistent (incidental parameters problem)
  • Partial effects \partial F / \partial x_{it} are contaminated by \hat{\mu}_i
  • Standard panel “fixes” (first-differences, Within) are no longer valid

A Unified Latent Variable Framework

A latent continuous y^*_{it} underlies all limited dependent variable models:

y^*_{it} = x'_{it}\beta + \mu_i + v_{it}

Different observability rules generate different model families:

Outcome Type Observability Rule Example
Binary choice y_{it} = \mathbf{1}[y^*_{it} > 0] Employment
Ordered y_{it} = j if \kappa_{j-1} < y^*_{it} \leq \kappa_j Terror scale
Censored (Tobit) y_{it} = \max(0,\, y^*_{it}) Hours worked
Truncated y_{it} = y^*_{it} if y^*_{it} > 0 Positive wages
Count \lambda_{it} = \exp(x'_{it}\beta + \mu_i) Patents, arrests

Roadmap: A Three-Axis Taxonomy

Three dimensions determine which estimator to use:

Axis 1 — Outcome type: Binary \to Ordered \to Count \to Censored / Truncated

Axis 2 — Effect treatment: Fixed effects (FE) \to Random effects (RE) \to Correlated RE (Mundlak/Chamberlain)

Axis 3 — Temporal structure: Static \to Observation-driven Markov \to Parameter-driven state space

After heterogeneity, we will have a dynamics taxonomy; at the end, there is a complete decision flowchart.

The Incidental Parameters Problem

The Problem Stated Precisely

Setting: N individuals, T periods, individual effects \{\mu_1,\ldots,\mu_N\} unknown.

As N \to \infty with T fixed, the number of nuisance parameters grows at the same rate as the sample — the MLE for (\beta, \mu_1,\ldots,\mu_N) is inconsistent for \beta.

Why it does not arise in the linear model:

The Within estimator eliminates \mu_i exactly before estimation. The MLE of \beta and \{\mu_i\} are asymptotically independent in the linear case (Hsiao 2003).

Why it arises in nonlinear models:

Each \hat{\mu}_i is estimated from only T observations. Inconsistency in \hat{\mu}_i is transmitted to \hat{\beta} because the nonlinear information matrix is not block-diagonal between \beta and \{\mu_i\}.

Magnitude of the Bias: Monte Carlo Evidence

For fixed effects logit as N \to \infty with T fixed:

T Asymptotic bias in \hat{\beta}_{MLE} Direction
2 \hat{\beta}_{MLE} \xrightarrow{p} 2\beta Away from zero
10 \approx 16\% Away from zero
20 \approx 6.9\% Away from zero

Sources: Hsiao (2003); Greene (2004a)

  • Bias is always away from zero (upward in absolute value)
  • At N = 1000, T = 2: bias \approx 100\% (Greene 2004a)
  • For probit the bias is similar in direction but slightly smaller
  • Exception: Fixed effects Poisson has no incidental parameters problem.

Three Strategies for the Incidental Parameters Problem

Strategy 1 — Condition out \mu_i (FE approach)

Find a sufficient statistic S_i for \mu_i; condition the likelihood on S_i. \mu_i is eliminated without being estimated. \to Exact for logit (Chamberlain 1980) and Poisson (Hausman et al. 1984). \to Not available for probit or Tobit in general.

Strategy 2 — Integrate out \mu_i (RE approach)

Assume \mu_i \sim F(\sigma_\mu^2); replace \mu_i by integrating over its distribution. \to Consistent if distribution correctly specified; correlated RE (Mundlak) relaxes independence.

Strategy 3 — Model and correct the bias (Modified MLE)

Reduce bias from O(1/T) to O(1/T^2) via jackknife or analytic correction. \to Carro (2007); Hahn & Newey (2004); especially useful for dynamic models.

The Incidental Parameters Problem in Dynamic Models

In static models the IPP involves only \beta and \{\mu_i\}.

In dynamic models with y_{i,t-1} as a regressor:

\Pr[y_{it} = 1 \mid x_{it}, y_{i,t-1}, \mu_i] = F(x'_{it}\beta + \gamma y_{i,t-1} + \mu_i)

Why it is worse dynamically:

  • y_{i,t-1} is itself a function of \mu_i (generated by the same model)
  • This introduces a second bias channel in \hat{\gamma}, beyond the standard IPP
  • The initial condition y_{i0} is correlated with \mu_i by construction

The initial conditions problem: y_{i0} is typically not exogenous. Ignoring this biases estimates of \gamma (state dependence) and compounds the IPP bias. \to We will address dynamic complications systematically after heterogeneity.

Fixed Effects Binary Choice — Conditional MLE

Chamberlain’s Sufficient Statistic

Key result (Chamberlain 1980): For the fixed effects logit, S_i = \sum_{t=1}^T y_{it} is a minimal sufficient statistic for \mu_i.

Conditional on S_i, the joint distribution of (y_{i1},\ldots,y_{iT}) does not depend on \mu_i.

L_c(\beta) = \prod_{i=1}^N \Pr\!\left(y_{i1},\ldots,y_{iT} \;\Big|\; \sum_{t=1}^T y_{it}\right)

Maximising L_c gives the CMLE — consistent and asymptotically normal as N \to \infty for fixed T. No incidental parameters problem.

The T = 2 Closed Form

For T = 2, conditioning on y_{i1} + y_{i2} = 1 (only “switchers” contribute):

\Pr[y_{i1}=1, y_{i2}=0 \mid y_{i1}+y_{i2}=1] = \frac{1}{1 + e^{(x_{i2}-x_{i1})'\beta}}

\Pr[y_{i1}=0, y_{i2}=1 \mid y_{i1}+y_{i2}=1] = \frac{1}{1 + e^{(x_{i1}-x_{i2})'\beta}}

Key observations:

  • \mu_i has completely dropped out — consistent estimation possible
  • Units with y_{i1} = y_{i2} (non-switchers) contribute nothing to L_c
  • Equivalent to standard logit on the “switcher” subsample with \Delta x_i as regressors

Generalising to T > 2 and Manski’s Alternative

For T > 2: \sum_t y_{it} can be 0,1,\ldots,T. Observations with \sum_t y_{it} \in \{0,T\} contribute nothing. Conditional probabilities computed recursively — implemented in xtlogit, fe and clogit.

Manski’s (1987) maximum score estimator: Semiparametric alternative when the logistic assumption is too strong:

\max_\beta \; \frac{1}{n} \sum_{i=1}^n z_i \cdot \text{sgn}(x'_i \beta), \quad z_i = 2y_i - 1

Maximises correct predictions; no likelihood assumed.

Limitations: Convergence rate N^{1/3} not \sqrt{N}; no information-matrix standard errors — bootstrap required.

Testing: Hausman Test for Individual Effects

H_0: No individual effects — pooled logit is consistent and efficient.

Under H_1: CMLE is consistent; pooled MLE is not.

m = (\hat{\beta}_{CML} - \hat{\beta}_{MLE})' \left[\widehat{V}_{CML} - \widehat{V}_{MLE}\right]^{-1} (\hat{\beta}_{CML} - \hat{\beta}_{MLE}) \;\sim\; \chi^2_K

under H_0.

Practical note: CMLE discards non-switchers so it is less efficient under H_0. The test asks: is the efficiency cost worth the bias protection under H_1? An alternative: use the Mundlak test in xtprobit

Semiparametric Extensions and Bounds

Honoré & Lewbel (2002): Chamberlain’s negative identification result can be overturned if at least one continuous “special regressor” is independent of \mu_i. Allows \sqrt{N}-consistent semiparametric estimation without the logistic assumption.

Magnac (2004): \sum_t y_{it} is a sufficient statistic under necessary and sufficient conditions strictly weaker than the logit model — the result generalises beyond logit to the “odds ratio” restriction.

Honoré & Tamer (2006): When point identification fails, bounds on \beta can be constructed. The identified set is often informatively small in practice — useful when exact point identification requires implausible assumptions.

Random Effects Binary Choice

The T-Dimensional Integral Problem

For RE probit, u_{it} = \mu_i + v_{it}, where \mu_i \sim \text{IIN}(0,\sigma_\mu^2), v_{it} \sim \text{IIN}(0,1).

The individual likelihood is a T-dimensional integral — infeasible for large T.

Conditioning on \mu_i makes the v_{it} independent, reducing to a single integral:

L_i = \int \left[\prod_{t=1}^T \Phi\!\left(q_{it}(x'_{it}\beta + \mu_i)\right)\right] \phi\!\left(\frac{\mu_i}{\sigma_\mu}\right) \frac{d\mu_i}{\sigma_\mu}

where q_{it} = 2y_{it} - 1 and \Phi is the standard normal CDF.

Butler–Moffitt (1982) Gauss–Hermite Quadrature

The single remaining integral is approximated by Gauss–Hermite quadrature:

\ln L_h = \sum_{i=1}^N \ln\!\left[\frac{1}{\sqrt{\pi}} \sum_{h=1}^H w_h \prod_{t=1}^T \Phi\!\left(q_{it}(x'_{it}\beta + \theta z_h)\right)\right]

where \theta = \sigma_\mu\sqrt{2}, and w_h, z_h are quadrature weights and nodes.

  • H = number of quadrature points; accuracy increases with H
  • Default H = 12 in Stata; H = 24 recommended for larger \sigma_\mu
  • Adaptive Gauss–Hermite quadrature (AGQ): More accurate, default in lme4 (R)

Mundlak Device and Chamberlain Correlated RE

Problem with basic RE probit: Assumes \mu_i \perp x_{it} — often unrealistic.

Mundlak (1978) device: Let \mu_i = \bar{x}'_i \delta + \varepsilon_i where \bar{x}_i = T^{-1}\sum_t x_{it}.

\Pr[y_{it} = 1 \mid x_{it}, \bar{x}_i] = \Phi\!\left((1+\sigma_\varepsilon^2)^{-1/2}(x'_{it}\beta + \bar{x}'_i \delta)\right)

Consistent even when \mu_i is correlated with x_{it}. Implement by adding \bar{x}_i as regressors to xtprobit.

Chamberlain (1984) extension: \mu_i = x'_{i1}a_1 + \cdots + x'_{iT}a_T + \varepsilon_i — more flexible but uses TK additional parameters.

Test: H_0: \delta = 0 in Mundlak specification tests whether RE assumption is valid.

Choosing Between FE Logit and RE Probit

FE Conditional Logit

  • No distributional assumption on \mu_i
  • Allows arbitrary \text{Corr}(\mu_i, x_{it})
  • Requires logistic distribution for v_{it}
  • Discards all non-switchers
  • No partial effects for time-invariant x

RE Probit (Mundlak)

  • Uses full sample
  • Normal distribution for v_{it}
  • Partial effects for time-invariant x available
  • Requires distributional assumption on \mu_i
  • Consistent even if \text{Corr}(\mu_i, x_{it}) \neq 0 (via Mundlak)

Practical recommendation: Use correlated RE probit (Mundlak device) as the default. Report FE logit as a robustness check. Test H_0: \delta = 0 to guide the choice.

Ordinal Outcomes — Static Models

The Ordered Latent Variable Model

Observable y_{it} \in \{1,2,\ldots,J\} generated by threshold-crossing of y^*_{it}:

y_{it} = j \iff \kappa_{j-1} < y^*_{it} \leq \kappa_j, \quad -\infty = \kappa_0 < \kappa_1 < \cdots < \kappa_J = +\infty

With panel structure: y^*_{it} = x'_{it}\beta + \mu_i + v_{it}

\Pr[y_{it} = j \mid x_{it}, \mu_i] = F(\kappa_j - x'_{it}\beta - \mu_i) - F(\kappa_{j-1} - x'_{it}\beta - \mu_i)

The panel complication: \mu_i shifts the entire probability distribution — the same incidental parameters problem as in binary choice, but across J categories.

No sufficient statistic for \mu_i in general for J > 2 — hence no FE ordered probit analogous to FE logit.

Random Effects Ordered Probit

Direct extension of RE Probit: \mu_i \sim \text{IIN}(0,\sigma_\mu^2) independent of v_{it} \sim \text{IIN}(0,1).

The individual likelihood involves the same single integral as RE probit — Butler–Moffitt quadrature applies directly.

Stata: xtoprobit y x1 x2, intpoints(24)

R: ordinal::clmm(ordered(y) ~ x1 + x2 + (1|id), link = "probit")

Correlated RE (Mundlak device): Add \bar{x}_i as regressors to allow \text{Corr}(\mu_i, x_{it}) \neq 0.

Post-estimation: margins / marginaleffects for category-specific average partial effects.

Fixed Effects Ordered Logit — The BUC Estimator

Problem: No general sufficient statistic for \mu_i in the ordered logit with J > 2.

Baetschmann, Staub & Winkelmann (2015) — “Blow-Up and Cluster” (BUC):

  1. For each threshold j \in \{1,\ldots,J-1\}, dichotomise: \tilde{y}_{it}^{(j)} = \mathbf{1}[y_{it} > j]
  2. Run FE conditional logit on each binary outcome \tilde{y}_{it}^{(j)} separately
  3. “Blow-up”: Stack all J-1 binary datasets into one long dataset
  4. “Cluster”: Constrain \beta equal across j; cluster-robust SEs for dependence

Stata: ssc install buc then buc y x1 x2, group(id) vce(cluster id)

R: bife::bife() for each binary collapse, then stack and cluster

Generalised Ordered Models and Parallel Regression

The parallel regression assumption: Same \beta governs all thresholds j. Often violated.

Generalised ordered logit: Allow \beta to vary across thresholds:

\Pr[y_{it} > j \mid x_{it}] = F(x'_{it}\beta_j), \quad j = 1,\ldots,J-1

Stata: gologit2 (Williams 2006) — partial proportionality available (pl() option)

R: VGAM::vglm(y ~ x, family = cumulative(parallel = FALSE))

Testing: Brant test in Stata (brant after ologit); LR test comparing constrained vs unconstrained models.

Panel extension: xtgologit2 (community SSC) for RE generalised ordered probit; Mundlak device as workaround for FE.

Panel Count Models — Static

Why Counts Need Special Treatment

Panel count outcomes: patents, doctor visits, arrests, protest events, conflict incidents.

The natural model — Poisson with E[y_{it} \mid x_{it}, \mu_i] = \exp(x'_{it}\beta + \mu_i) — faces three complications:

  1. Incidental parameters: \mu_i cannot be swept out by demeaning \exp(\cdot)
  2. Overdispersion: \text{Var}[y_{it}] > E[y_{it}] is ubiquitous in practice
  3. Excess zeros: Many panels have a large fraction of zero counts

But: The FE Poisson model has a unique property that exempts it from the incidental parameters problem — the most important positive result in this chapter.

Fixed Effects Poisson — The “Blessing”

Hausman, Hall & Griliches (1984): S_i = \sum_{t=1}^T y_{it} is a sufficient statistic for \mu_i in the Poisson model — and, uniquely, there is no incidental parameters problem.

The conditional likelihood reduces to a multinomial likelihood depending only on \beta:

\Pr\!\left[y_{it} \;\Big|\; \sum_t y_{it}\right] \;\propto\; \prod_t \left(\frac{\exp(x'_{it}\beta)}{\sum_s \exp(x'_{is}\beta)}\right)^{y_{it}}

Wooldridge (1999) QMLE: FE Poisson is consistent even if the count distribution is misspecified, provided E[y_{it} \mid \mu_i, x_{it}] = \exp(x'_{it}\beta + \mu_i) holds. Only the conditional mean needs to be correctly specified.

Stata: xtpoisson y x1 x2, fe vce(cluster id)

R: fixest::fepois(y ~ x1 + x2 | id, vcov = ~ id, data = df)

Overdispersion and the Negative Binomial

Overdispersion (\text{Var}[y_{it}] > E[y_{it}]) is nearly universal in practice.

Approach 1 — RE Negative Binomial (HHG 1984): Assume \exp(\mu_i) \sim \text{Gamma}(\alpha,\alpha). Integrating out \mu_i gives the NB marginal distribution. Stata: xtnbreg, re

Approach 2 — Robust FE Poisson (recommended): Use FE Poisson QMLE with robust standard errors. Overdispersion inflates SE but does not bias \hat{\beta}. Stata: xtpoisson, fe vce(cluster id)

Warning on xtnbreg, fe: The FE NB in Stata absorbs \mu_i through the overdispersion parameter (not the mean) — Allison & Waterman (2002) showed this does NOT fully control for time-invariant heterogeneity. Use with caution; prefer robust FE Poisson.

Random Effects Count Models and Specification Tests

RE Poisson with Normal mixing: \mu_i \sim \text{Normal}(0,\sigma_\mu^2) — requires quadrature. Stata: xtpoisson, re (Normal mixing) or xtpoisson, gamma (Gamma mixing)

Specification tests:

Test Command (Stata) H_0
Random effects xttest0 after xtpoisson, re \sigma_\mu^2 = 0
Overdispersion LR: xtpoisson, re vs xtnbreg, re No extra dispersion
FE vs RE hausman fe re E[\mu_i \mid x_{it}] = 0
Serial correlation xtserial (SSC) No serial correlation

Pre-sample mean proxy (Blundell, Griffith & Windmeijer 2002): Include \log(\bar{y}_{i,\text{pre}}) as offset or regressor — a practical proxy for \mu_i that avoids conditioning on \sum_t y_{it}.

Zero-Inflation and Dynamic Counts

Zero-inflated Poisson (ZIP): Two-part model — probability \pi of structural zero + Poisson count. For panel data: zip with vce(cluster id) in Stata; community-contributed xtzip.

Hurdle model: Separate binary participation equation + truncated count equation (positive counts only). More interpretable than ZIP when zeros and positives have different determinants.

Blundell, Griffith & Windmeijer (2002) pre-sample mean: A practical dynamic proxy:

gen log_pre = log(pre_sample_mean + 0.5)
xtpoisson y x1 x2 log_pre l.y i.year, fe vce(cluster id)

Testing dynamics: LR test comparing static vs dynamic Poisson; check residual ACF after xtpoisson, fe for remaining serial correlation.

Dynamics — The Unifying Framework

Cox’s Taxonomy: Two Types of Dynamic Models

Cox (1981) distinguishes two fundamental classes of dynamic models:

Observation-driven: The conditional distribution f(y_{it} \mid \mathcal{F}_{i,t-1}, x_{it}, \mu_i) depends on past outcomes directly through the filtration \mathcal{F}_{i,t-1} = \{y_{i,t-1}, y_{i,t-2}, \ldots\}. \to Likelihood is a product of closed-form one-period-ahead predictive densities. \to Examples: dynamic logit/probit, ordered Markov, INGARCH.

Parameter-driven: A latent process \alpha_{it} evolves by its own Markov law; y_{it} depends on \alpha_{it} and x_{it} but not directly on y_{i,t-1}. \to Likelihood requires integrating over the path of \alpha_{it} — computationally intensive. \to Examples: state space probit, dynamic factor models with discrete outcomes.

True vs Spurious State Dependence

Heckman (1981c) distinguishes two reasons for persistence in panel outcomes:

True state dependence: The past outcome y_{i,t-1} causally changes future probabilities.

\Pr[y_{it} = 1 \mid x_{it}, y_{i,t-1}=1, \mu_i] > \Pr[y_{it} = 1 \mid x_{it}, y_{i,t-1}=0, \mu_i]

Spurious state dependence: Persistence driven by unobserved \mu_i that is stable over time — certain individuals always have high (or low) probabilities regardless of history.

Why it matters: True state dependence implies interventions should be early (to break the cycle). Spurious state dependence implies targeting the underlying heterogeneity.

Testing: \gamma \neq 0 in F(x'_{it}\beta + \gamma y_{i,t-1} + \mu_i), after controlling for \mu_i.

The Initial Conditions Problem: A Unified Treatment

In any dynamic panel GLM, y_{i0} is typically not exogenous — it was generated by the same model containing \mu_i.

Three solutions, applicable across all outcome types:

Approach Method Software
Heckman (1981b) Reduced-form approximation for f(y_{i0} \mid x_i, \mu_i) Custom code
Wooldridge (2005) Model \mu_i \mid (y_{i0}, \bar{x}'_i) as normal; add y_{i0}, \bar{x}_i as regressors Standard RE routines
Semiparametric Condition on sufficient statistics (logit, Poisson) clogit, xtpoisson, fe

Practical recommendation: The Wooldridge (2005) device is the most versatile — it applies to binary, ordered, count, and Tobit models with minimal additional code.

Dynamic Binary Panel Models

The Dynamic Binary Choice Model

The first-order Markov binary panel model:

\Pr[y_{it} = 1 \mid x_{it}, y_{i,t-1}, \mu_i] = F(x'_{it}\beta + \gamma y_{i,t-1} + \mu_i)

\gamma \neq 0 implies true state dependence (conditional on individual effects).

Key challenge: The incidental parameters problem gets worse — both \mu_i and the lagged outcome y_{i,t-1} create bias channels in the MLE.

Testing state dependence: An LR test of H_0: \gamma = 0 after properly controlling for \mu_i is the cleanest diagnostic. A Wald test also works.

Static model bias from ignoring dynamics: If \gamma \neq 0, omitting y_{i,t-1} from the static model causes omitted variable bias in \hat{\beta} (through the correlation of x_{it} with past outcomes).

Wooldridge (2005) Initial Conditions Device in Practice

Step-by-step implementation:

Step 1: Compute group means \bar{x}_i = T^{-1}\sum_t x_{it}

Step 2: Specify the conditional distribution of \mu_i:

\mu_i \mid y_{i0}, \bar{x}_i \;\sim\; \text{Normal}(\gamma_0 y_{i0} + \bar{x}'_i \delta, \sigma_a^2)

Step 3: Substitute and run standard RE probit with augmented regressors:

\Pr[y_{it}=1] = \Phi\!\left(\tilde{x}'_{it}\tilde{\beta} + \tilde{\gamma} y_{i,t-1} + \gamma_0 y_{i0} + \bar{x}'_i \delta\right)

In Stata:

bysort id: egen xbar1 = mean(x1)
bysort id: egen xbar2 = mean(x2)
xtprobit y x1 x2 l.y y0 xbar1 xbar2, re

Honoré & Kyriazidou (2000): Semiparametric FE Dynamic Logit

For the dynamic FE logit model, the sufficient statistic argument does not directly extend because y_{i,t-1} is correlated with \mu_i.

Honoré & Kyriazidou (2000): Identification requires the strict exogeneity condition x'_{i2} = x'_{i3} for T = 3. Under this condition, a conditional likelihood is available that eliminates \mu_i.

Kernel weighting: Since x'_{i2} = x'_{i3} exactly is a zero-probability event with continuous x, kernel weights K\!\left(\frac{x_{i2}-x_{i3}}{h_N}\right) are applied.

Limitation: Convergence rate slower than \sqrt{N}; computationally intensive.

Practical guidance: For most applied datasets, the Wooldridge (2005) device is more practical.

Carro (2007) and Application: Union Membership

Carro (2007): Modified MLE (MMLE) — corrects the concentrated loglikelihood to eliminate the first-order O(1/T) bias term. Performs well for T \geq 8.

Panel length Recommended estimator
T \leq 3 Wooldridge (2005) device
T = 48 Wooldridge (2005) or Carro (2007)
T > 8 FE MLE with Carro bias correction, or Wooldridge

Vella & Verbeek (1998) / Wooldridge (2005): PSID, 545 full-time male workers, 1980–87. Dynamic RE probit (Wooldridge device), average partial effects of state dependence:

Sample \hat{\gamma}_{\text{APE}} Std. Error
Married men 0.182 (0.041)
Unmarried men 0.173 (0.052)

Prior union membership increases \Pr[\text{union}] by \approx 18\%true state dependence.

Dynamic Ordered Panel Models

Why Ordered Outcomes Need Their Own Dynamic Treatment

With binary outcomes: one lag y_{i,t-1} \in \{0,1\} — one parameter \gamma.

With J ordered categories, y_{i,t-1} can enter in three ways:

  1. Single continuous score: \gamma \cdot y_{i,t-1} — assumes equal spacing, restrictive
  2. J-1 category dummies: \sum_{k=1}^{J-1} \gamma_k \mathbf{1}[y_{i,t-1}=k] — fully flexible, J-1 persistence parameters
  3. Full transition matrix: P(y_{it}=j \mid y_{i,t-1}=k) — the Markov chain estimand

The transition matrix approach is the most general — it allows asymmetric persistence: escalation may differ from de-escalation, a key substantive question in conflict, repression, and disease progression research.

The First-Order Markovian Ordered Probit/Logit

The ordered observation-driven Markov model:

\Pr[y_{it} \leq j \mid y_{i,t-1}, x_{it}, \mu_i] = F\!\left(\kappa_j - x'_{it}\beta - \sum_{k=1}^{J-1} \gamma_k \mathbf{1}[y_{i,t-1}=k] - \mu_i\right)

Estimands of interest:

  • \gamma_k: state-specific persistence — the shift in \Pr[y_{it} \leq j] when in state k yesterday
  • \partial \Pr[y_{it}=j] / \partial x_{it}: conditional marginal effects
  • Full J \times J predicted transition matrix P_{kj}(x_{it}, \mu_i)

The J \times J predicted transition matrix evaluated at covariate means gives the most interpretable summary of dynamic persistence.

Application: Democracy, Repression, and Path Dependence

Walker (2006, working paper): “Democracy and Human Rights Abuses: Insights from First-Order Markov Models”

Data: 1976–2003, country-year panel; six measures of human rights abuses including the Political Terror Scale (PTS, 1–5) and CIRI physical integrity index.

Key finding: The effect of political democracy on human rights abuses depends critically on the past level of repression. The \gamma_k parameters reveal:

  • At low prior repression (k = 1, 2): democracy significantly limits future abuses
  • At high prior repression (k = 4, 5): democracy has no discernible constraining effect

Methodological contribution: A static ordered probit cannot recover this history-contingent relationship. The Markov structure is essential for the substantive finding.

RE Dynamic Ordered Probit in Practice

Contoyannis, Jones & Rice (2004) apply the Wooldridge device to ordered outcomes — the canonical implementation.

Step-by-step:

  1. Define y_{i0} dummy variables: \mathbf{1}[y_{i0} = 2], \ldots, \mathbf{1}[y_{i0} = J-1]
  2. Compute group means \bar{x}_i
  3. Run xtoprobit with lagged category dummies + y_{i0} dummies + \bar{x}_i
* Wooldridge device for RE dynamic ordered probit
xtoprobit y L1.y_cat2 L1.y_cat3 L1.y_cat4 x1 x2  ///
          y0_cat2 y0_cat3 y0_cat4                   ///
          xbar1 xbar2, intpoints(24)

Post-estimation: Predict the full transition matrix:

margins, predict(pr outcome(1)) predict(pr outcome(2)) ///
         predict(pr outcome(3)) at(y_lag=(1 2 3))

FE Dynamic Ordered Logit and Practical Guidance

Müller, Raposo & Vandoros (2021): For T = 3, observations satisfying x'_{i2} = x'_{i3} yield a conditional likelihood that eliminates \mu_i from the dynamic ordered logit. No standard software implementation yet.

Testing state dependence: LR test: compare xtoprobit with vs. without lagged category dummies — \chi^2_{J-1} under H_0: \gamma_1 = \cdots = \gamma_{J-1} = 0

Testing asymmetric persistence: Wald test: H_0: \gamma_1 = \gamma_2 = \cdots = \gamma_{J-1}

Computing the transition matrix in R:

library(marginaleffects)
predictions(mod, newdata = datagrid(y_lag = 1:J), 
            type = "probs") |>
  pivot_wider(names_from = group, values_from = estimate)

Dynamic Count Panel Models

INGARCH and Score-Driven Models for Counts

Davis, Dunsmuir & Streett (2003) / Harvey & Fernandes (1989): The observation-driven INGARCH(1,1):

y_{it} \mid \mathcal{F}_{i,t-1} \sim \text{Poisson}(\lambda_{it}), \quad \lambda_{it} = \omega_i + \alpha y_{i,t-1} + \beta \lambda_{i,t-1}

Closed-form likelihood as a product of Poisson densities. Persistence: \alpha + \beta; stationary if \alpha + \beta < 1.

Creal, Koopman & Lucas (2013) GAS framework: Update \lambda_{it} via the scaled score:

\lambda_{it} = \omega + A \cdot s_{i,t-1} + B \cdot \lambda_{i,t-1}, \quad s_{it} = \nabla_{it} \cdot \mathcal{I}_{it}^{-1}

Distribution Score s_{it} Model
Poisson y_{it}/\lambda_{it} - 1 INGARCH(1,1)
Negative Binomial (y_{it} - \lambda_{it})/(\lambda_{it}(1 + \alpha^{-1}\lambda_{it})) NB-GAS

Dynamic FE Poisson: Blundell, Griffith & Windmeijer (2002)

The pre-sample mean approach for dynamic count panel models:

\log \lambda_{it} = x'_{it}\beta + \gamma \log y_{i,t-1} + \log \bar{y}_{i,\text{pre}} + v_{it}

where \bar{y}_{i,\text{pre}} is the pre-sample mean count — a proxy for \exp(\mu_i).

Implementation in Stata:

gen log_pre = log(pre_sample_mean + 0.5)
xtpoisson y x1 x2 l.y log_pre, fe

In R with fixest:

fepois(y ~ x1 + x2 + log(lag_y) + offset(log_pre_mean) | id, data = df)

Arellano-Bond GMM alternative (Windmeijer 2000): Instrument y_{i,t-1} with y_{i,t-2}, y_{i,t-3}, \ldots in first-differenced equations. Consistent under serial uncorrelation of v_{it}.

Overdispersion, NB Dynamics, and Testing

NB-INGARCH: Replace Poisson with NB in the INGARCH framework:

y_{it} \mid \mathcal{F}_{i,t-1} \sim \text{NB}(\lambda_{it}, \phi), \quad \lambda_{it} = \omega + \alpha y_{i,t-1} + \beta \lambda_{i,t-1}

Available via tscount::tsglm(distr = "nbinom") in R.

Dynamic hurdle models: For excess zeros with dynamics:

  1. Participation equation: \Pr[y_{it} > 0] — dynamic binary logit
  2. Count equation: y_{it} \mid y_{it} > 0 — dynamic Poisson/NB (truncated)

Testing dynamics:

  • LR test comparing static vs dynamic Poisson
  • Check residual ACF after xtpoisson, fe for remaining serial correlation
  • Test H_0: \gamma = 0 (no lagged count effect) via Wald test

Simulation Estimators

Why Simulation? The Multinomial Panel Probit

For a multinomial probit panel model with M alternatives and T periods, the choice probability involves a T(M-1)-dimensional integral:

\Pr[\mathbf{y}_i = \mathbf{j}] = \int_{\mathcal{A}_j} f(\boldsymbol{\varepsilon}_i)\, d\boldsymbol{\varepsilon}_i

where \mathcal{A}_j is a high-dimensional region and \boldsymbol{\varepsilon}_i \in \mathbb{R}^{T(M-1)}.

  • For M = 4, T = 8: 24-dimensional integral — infeasible by quadrature
  • GHK simulator (Geweke-Hajivassiliou-Keane): factors the joint probability into a product of univariate conditionals — each integral is one-dimensional
  • MSM sidesteps the high-dimensional integral by simulating choice sequences from the model

The GHK Simulator

Step 1: Decompose the error covariance \Sigma = LL' (Cholesky decomposition).

Step 2: Express choice probabilities as a product of univariate conditional probabilities using the triangular structure of L.

Step 3: Draw antithetic samples \eta^{(r)} \sim \text{Normal}(0, I), r = 1, \ldots, R.

Step 4: Compute simulated probability:

\hat{P}_{ij} = \frac{1}{R}\sum_{r=1}^R \prod_{t=1}^T \Phi\!\left(\frac{u_{it}^{(r)} - \ell'_{it}\eta^{(r)}_{<t}}{\ell_{tt}}\right)

Simulated MLE: \max_\theta \sum_i \log \hat{P}_{iy_i}(\theta) — consistent as R, N \to \infty; bias O(1/R).

Practical rule of thumb: R \geq 10\sqrt{N} draws (Hajivassiliou & Ruud 1994). For N = 1000, R \geq 316 draws — feasible on modern hardware.

MSM vs Simulated MLE: Practical Guidance

When to prefer MSM (Keane 1994):

  • MLE computationally infeasible (large T, large M)
  • Complex or unknown serial correlation patterns
  • Objective is to match moments rather than maximise likelihood

When to prefer simulated MLE:

  • Moderate T and M, large R feasible
  • Distributional assumption credible
  • Efficiency paramount (SML \sim MLE in simulation size)

Software: Stata asmprobit and asroprobit; R mlogit::mlogit() with probit = TRUE; custom GHK implementation for complex models.

Censored and Truncated Panel Data Models

The Panel Tobit Model

Standard Tobit: y^*_{it} = x'_{it}\beta + \mu_i + v_{it}, v_{it} \sim \text{IIN}(0, \sigma_v^2)

Observed: y_{it} = \max(0, y^*_{it}) — hours worked, expenditure, donations.

Heckman & MaCurdy (1980): Fixed effects Tobit with life-cycle motivation. FE Tobit MLE maximises \sum_i \ln L_i(\beta, \mu_i, \sigma_v) simultaneously — suffers from the incidental parameters problem.

Random effects Tobit: Assume \mu_i \sim \text{IIN}(0, \sigma_\mu^2); Butler-Moffitt quadrature applies:

L_i = \int \prod_t \left[\Phi\!\left(\frac{x'_{it}\beta + \mu_i}{\sigma_v}\right)^{1-y_{it}}\phi\!\left(\frac{y_{it} - x'_{it}\beta - \mu_i}{\sigma_v}\right)^{y_{it}/\sigma_v}\right] \phi\!\left(\frac{\mu_i}{\sigma_\mu}\right) \frac{d\mu_i}{\sigma_\mu}

Stata: xttobit y x1 x2 (RE only; no built-in FE Tobit)

FE Tobit MLE Bias and Honoré (1992) Trimmed LAD

Greene (2004a,b): The FE Tobit bias is approximately equal to the censoring fraction:

Censoring FE Tobit MLE Honoré LAD
< 20\% Acceptable bias May be overkill
20\%40\% Noticeable bias Recommended
> 40\% Severe bias Essential

Honoré (1992) Trimmed LAD: Exploit symmetry of y^*_{it} around x'_{it}\beta + \mu_i to construct moment conditions free of \mu_i.

\beta_{LAD} = \argmin_\beta \sum_{i}\sum_{t>s} \left[|y_{it} - y_{is} - (x_{it}-x_{is})'\beta| - \text{trim}(\cdot)\right]

  • Consistent and asymptotically normal as N \to \infty for fixed T
  • No distributional assumption on v_{it} or \mu_i
  • Stata: ssc install honor; then honor y x1 x2, model(tobit) ll(0) group(id)

Dynamic Tobit and Kyriazidou Sample Selection

Honoré (1993) Dynamic Tobit: Adds y_{i,t-1} to the Tobit model:

y^*_{it} = x'_{it}\beta + \lambda y_{i,t-1} + \mu_i + v_{it}, \quad y_{it} = \max(0, y^*_{it})

Exploits symmetry conditions on v_{it} to construct GMM estimators free of \mu_i.

Kyriazidou (1997) Type 2 Tobit (sample selection model):

y^*_{1it} = x'_{1it}\beta_1 + \mu_{1i} + v_{1it} \quad \text{(selection)} y^*_{2it} = x'_{2it}\beta_2 + \mu_{2i} + v_{2it} \quad \text{(outcome, observed when } y_{1it}=1)

First-differencing eliminates \mu_{2i}; kernel weights handle selection. → Applied to nurses data.

Selection Bias and Attrition

Panel-Specific Attrition: The Problem

Panel surveys are repeated cross-sections — individuals who drop out are permanently lost.

Two types of missing data:

  • Ignorable (MAR): Dropout is unrelated to y_{it} conditional on observables — standard panel methods remain valid
  • Nonignorable (MNAR): Dropout depends on y_{it} (even conditional on observables) — standard methods are biased

Panel-specific sources of nonignorable attrition: health deterioration, geographic mobility, survey fatigue, institution-level attrition (firm closure, country exit).

Testing ignorability: Verbeek & Nijman (1992a): include attrition-related variables (s_{it-1}, \prod_t s_{it}, T_i) as regressors — significant coefficients suggest nonignorable selection.

Panel Extension of Heckman’s Two-Step

Cross-section Heckman (1979): One selectivity correction term (inverse Mills ratio \lambda(\cdot)).

Panel extension (Verbeek & Nijman 1992b): Following Hausman & Wise (1979):

E[y_{it} \mid x_{it}, \mu_i, r_{it}=1] = x'_{it}\beta + \mu_i + \sigma_{\mu\varepsilon}\lambda_{\mu}(\cdot) + \sigma_{\eta v}\lambda_{\eta}(\cdot)

Two selectivity correction terms:

  1. Correlation between individual effects \mu_i and the selection disturbance
  2. Correlation between time-varying errors v_{it} and the selection disturbance

Both require numerical integration — a significant computational burden vs. the cross-section case.

Wooldridge (1995) Variable Addition Test and Hausman Tests

Wooldridge (1995) variable addition test:

  1. For each t, run Tobit (or probit) for the selection rule; compute residuals \hat{\varepsilon}_{it}
  2. Demean: \tilde{\varepsilon}_{it} = \hat{\varepsilon}_{it} - \bar{\hat{\varepsilon}}_{i}
  3. Run FE regression of y_{it} on x_{it} and \tilde{\varepsilon}_{it}
  4. Test H_0: \gamma = 0 — rejection suggests nonignorable selection

Verbeek & Nijman (1992a) four-estimator Hausman tests:

Let \hat{\delta} = (\tilde{\beta}_W(B),\; \tilde{\beta}_W(U),\; \tilde{\beta}_{GLS}(B),\; \tilde{\beta}_{GLS}(U)) where B = balanced subpanel, U = full panel.

Test contrasts (R_1R_4) compare Within vs GLS estimators across balanced and unbalanced subpanels — all should agree under ignorable selection.

Empirical Application — Nurses’ Labour Supply

Data and Research Design

Askildsen, Baltagi & Holmås (2003): Do wages raise female labour supply among nurses?

Data: 19,638 Norwegian female nurses, 1993–98; six-year matched panel; 69,122 observations.

Three simultaneous challenges:

  • Individual heterogeneity: Nurses differ in unobserved productivity, preferences, family responsibilities
  • Sample selection: Hours observed only for participating nurses
  • Endogeneity: High-productivity nurses earn more AND work more

Estimation strategy (Kyriazidou 1997):

  1. Step 1: Conditional logit (FE) participation equation; kernel weights constructed
  2. Step 2: Kyriazidou IV hours equation using lagged municipality financial surplus and auxiliary nurse wage as instruments

Step 1 — Participation Equation (Selected Results)

Conditional logit estimates (Table 11.1 — selected coefficients):

Variable Estimate Std. Error
Educated nursing specialist 0.616** (0.069)
Age 0.113** (0.034)
Age^2 −0.004** (0.000)
Number of children −0.264** (0.046)
Children < 3 years −0.142** (0.042)
Disable −1.268** (0.224)
Hospital in municipality 0.646** (0.062)
Participation rate (local) 0.035** (0.007)

** Significant at 1%; * at 5%. Log-likelihood = -22{,}287.46; N = 61{,}464.

Step 2 — Hours Equation and Lessons

Kyriazidou (1997) IV estimates (Table 11.2 — selected coefficients):

Variable Estimate Std. Error
Ln wage 0.208* (0.094)
Shift work −0.011** (0.001)
Hour 35.5 contract −0.040** (0.005)
Disabled −0.258** (0.026)
Single 0.021** (0.004)
Children < 3 years −0.050** (0.003)

** Significant at 1%; * at 5%. N = 121{,}622. Wage elasticity = 0.21 after corrections.

Methodological lesson: The panel structure is essential — simultaneous FE, selection correction, and IV are only feasible with repeated observations of the same individuals.

Computing Panel GLMs in Stata and R

Architecture: Command Reference Table

Model FE Estimator RE Estimator
Binary logit xtlogit, fe / clogit xtlogit, re
Binary probit — (no FE probit) xtprobit, re
Ordered logit/probit buc (SSC) xtoprobit
Poisson count xtpoisson, fe xtpoisson, re
Negative binomial xtnbreg, fe* xtnbreg, re
Tobit (censored) — (use Honoré) xttobit
Sample selection Kyriazidou honor Heckman + panel

*Use with caution — as explained in Panel Count Models

R: fixest::feglm(), pglm::pglm(), lme4::glmer(), ordinal::clmm(), fixest::fepois()

Binary Outcomes — Stata

Fixed effects (conditional logit):

xtlogit y x1 x2 i.year, fe vce(cluster id)
clogit y x1 x2 i.year, group(id) vce(cluster id)

Random effects probit with Mundlak device:

bysort id: egen xbar1 = mean(x1)
bysort id: egen xbar2 = mean(x2)
xtprobit y x1 x2 i.year xbar1 xbar2, re intpoints(24)

* Test H0: corr(mu_i, x_it) = 0
test xbar1 xbar2

Post-estimation average partial effects:

margins, dydx(*) predict(pu0)

Binary Outcomes — R

Fixed effects conditional logit:

library(survival)
clogit(y ~ x1 + x2 + factor(year) + strata(id), data = df)

# Or with fixest (faster for large datasets)
library(fixest)
feglm(y ~ x1 + x2 | id + year, family = binomial, data = df)

Random effects probit with Mundlak device:

library(lme4)
df$xbar1 <- ave(df$x1, df$id)
df$xbar2 <- ave(df$x2, df$id)

glmer(y ~ x1 + x2 + xbar1 + xbar2 + (1|id),
      family = binomial(link = "probit"),
      data = df, nAGQ = 24)

Average partial effects:

library(marginaleffects)
avg_slopes(model, variables = c("x1", "x2"))

Ordinal Outcomes — Stata and R

Stata — RE ordered probit:

xtoprobit y x1 x2 i.year xbar1 xbar2, intpoints(24)
margins, predict(pr outcome(1)) predict(pr outcome(2)) ///
         predict(pr outcome(3)) dydx(x1)

Stata — FE ordered logit (BUC):

ssc install buc
buc y x1 x2, group(id) vce(cluster id)

R — RE ordered probit:

library(ordinal)
mod <- clmm(ordered(y) ~ x1 + x2 + xbar1 + xbar2 + (1|id),
            link = "probit", nAGQ = 24, data = df)
avg_slopes(mod, type = "cum.prob")

R — Generalised ordered logit:

VGAM::vglm(y ~ x1 + x2, family = cumulative(parallel = FALSE))

Count Outcomes — Stata and R

Stata — FE Poisson (recommended default):

xtpoisson y x1 x2 i.year, fe vce(cluster id)
xttest0  // Test H0: sigma_mu = 0

Stata — RE Poisson with overdispersion test:

xtpoisson y x1 x2, re
estimates store poisson_re
xtnbreg y x1 x2, re
lrtest poisson_re .  // One-sided test at boundary

R — FE Poisson with fixest (fastest):

library(fixest)
mod_fe <- fepois(y ~ x1 + x2 | id + year,
                 vcov = ~ id, data = df)

R — Dynamic count with INGARCH:

library(tscount)
tsglm(y_i, model = list(past_obs = 1, past_mean = 1),
      distr = "nbinom")

Censored, Truncated, and Sample Selection — Stata and R

RE Tobit (Stata):

xttobit y x1 x2 i.year, ll(0) vce(cluster id)
margins, dydx(*) predict(e(0,.))

Honoré (1992) FE Tobit (Stata):

ssc install honor
honor y x1 x2, model(tobit) ll(0) group(id)

RE Tobit (R):

library(censReg)
censReg(y ~ x1 + x2, left = 0, data = df)

Wooldridge (1995) selection test (Stata):

probit s z1 z2 x1 x2 if year == t
predict lambda_t, hazard
xtreg y x1 x2 lambda_t_demeaned, fe vce(cluster id)
test lambda_t_demeaned

Workflow, Diagnostics, and Common Pitfalls

Step 1 — Test for individual effects:

xttest0     // LM test H0: sigma_mu = 0
hausman fe re, sigmamore  // FE vs RE Hausman

Step 2 — Test for serial correlation:

xtserial y x1 x2  // Wooldridge test (install via SSC)

Step 3 — Test for selection (if unbalanced):

* Wooldridge (1995) variable addition test
* or compare Within and GLS on balanced vs unbalanced

Common pitfalls:

  • Not clustering SEs at the individual level
  • Using xtnbreg, fe without understanding the Allison-Waterman caveat
  • Ignoring non-switchers in FE logit (check: how many?)
  • Running xttobit when censoring fraction is high (> 30\%)
  • Reporting raw \hat{\beta} coefficients without average partial effects

Synthesis and Open Frontiers

Decision Flowchart

Step 1 — What type of outcome?

Binary → Blocks 2/3/6A | Ordered → Blocks 4/6B | Count → Blocks 5/6C | Censored → Block 8 | Selection → Block 9

Step 2 — FE or RE?

Run Mundlak test (test xbar1 xbar2 ...). Reject H_0 → Use FE (or correlated RE) | Fail to reject → RE sufficient

Step 3 — Is there temporal dependence?

Run serial correlation test (xtserial / pbgtest). Reject H_0 → Add lagged outcome; address initial conditions (Wooldridge 2005 device)

Step 4 — Is the panel balanced?

Unbalanced → Test ignorability of attrition (Wooldridge 1995 variable addition test). Reject → Full selection correction (Block 9)

Step 5 — Report average partial effects, not raw coefficients. Use margins / marginaleffects.

Open Frontiers and Current Developments

Partial identification in FE models: Honoré & Tamer (2006) provide informative bounds on \beta when point identification fails in FE binary choice. Extension to ordered and dynamic cases (Müller et al. 2021) is active research.

Machine learning and high-dimensional fixed effects: fixest handles millions of observations and thousands of fixed effects. Current research explores regularisation (LASSO, ridge) for selecting controls while maintaining consistent \hat{\beta} in panel GLMs.

Bayesian panel GLMs: Hasegawa (2009) — Bayesian dynamic ordered probit via MCMC. Schnakenberg & Fariss (2014) — dynamic ordinal IRT. Particularly valuable for short panels (T \leq 4) where frequentist FE methods discard too much information.

Non-rectangular panels and multiple imputation: Multiple imputation for missing panel data (Rubin 1987 extended to panel settings); pattern mixture models for MNAR data.

References:

Textbook foundations:

Incidental parameters: theory and Monte Carlo:

  • Neyman, J. & Scott, E.L. (1948). Consistent estimates based on partially consistent observations. Econometrica, 16(1), 1–32. doi:10.2307/1914288
  • Lancaster, T. (2000). The incidental parameter problem since 1948. Journal of Econometrics, 95(2), 391–413. doi:10.1016/S0304-4076(99)00044-5
  • Chamberlain, G. (1980). Analysis of covariance with qualitative data. Review of Economic Studies, 47(1), 225–238. doi:10.2307/2297110
  • Hsiao, C. (2003). Analysis of Panel Data, 2nd ed. Cambridge. doi:10.1017/CBO9780511754203
  • Greene, W.H. (2004a). The behaviour of the maximum likelihood estimator of limited dependent variable models. Econometrics Journal, 7(1), 98–119. doi:10.1111/j.1368-423X.2004.00123.x
  • Hahn, J. & Newey, W. (2004). Jackknife and analytical bias reduction for nonlinear panel models. Econometrica, 72(4), 1295–1319. doi:10.1111/j.1468-0262.2004.00533.x
  • Heckman, J.J. (1981b). The incidental parameters problem and the problem of initial conditions. In Manski & McFadden (eds.), Structural Analysis of Discrete Data. MIT Press.

Fixed effects binary choice:

  • Chamberlain, G. (1980). Analysis of covariance with qualitative data. Review of Economic Studies, 47(1), 225–238. doi:10.2307/2297110
  • Chamberlain, G. (1985). Heterogeneity, omitted variable bias, and duration dependence. In Heckman & Singer (eds.), Longitudinal Analysis of Labor Market Data. Cambridge. doi:10.1017/CBO9780511599712
  • Manski, C.F. (1987). Semiparametric analysis of random effects linear models from binary panel data. Econometrica, 55(2), 357–362. doi:10.2307/1913239
  • Honoré, B.E. & Lewbel, A. (2002). Semiparametric binary choice panel data models without strictly exogenous regressors. Econometrica, 70(5), 2053–2063. doi:10.1111/1468-0262.00358
  • Magnac, T. (2004). Panel binary variables and sufficiency: Generalizing conditional logit. Econometrica, 72(6), 1859–1876. doi:10.1111/j.1468-0262.2004.00548.x
  • Honoré, B.E. & Tamer, E. (2006). Bounds on parameters in panel dynamic discrete choice models. Econometrica, 74(3), 611–629. doi:10.1111/j.1468-0262.2006.00687.x
  • Greene, W.H. (2004a). The behaviour of the MLE of limited dependent variable models. Econometrics Journal, 7(1), 98–119. doi:10.1111/j.1368-423X.2004.00123.x

Random effects binary choice:

  • Butler, J.S. & Moffitt, R. (1982). A computationally efficient quadrature procedure for the one-factor multinomial probit model. Econometrica, 50(3), 761–764. doi:10.2307/1912613
  • Mundlak, Y. (1978). On the pooling of time series and cross section data. Econometrica, 46(1), 69–85. doi:10.2307/1913646
  • Chamberlain, G. (1984). Panel data. In Griliches & Intriligator (eds.), Handbook of Econometrics, Vol. 2, pp. 1247–1318. North-Holland.
  • Avery, R.B., Hansen, L.P. & Hotz, V.J. (1983). Multiperiod probit models and orthogonality condition estimation. International Economic Review, 24(1), 21–35. doi:10.2307/2526216
  • Guilkey, D.K. & Murphy, J.L. (1993). Estimation and testing in the random effects probit model. Journal of Econometrics, 59(3), 301–317. doi:10.1016/0304-4076(93)90028-B
  • Wooldridge, J.M. (2010). Econometric Analysis of Cross Section and Panel Data, 2nd ed. Chapters 15–16. MIT Press. mitpress.mit.edu

Ordered outcomes in panel data:

  • Baetschmann, G., Staub, K.E. & Winkelmann, R. (2015). Consistent estimation of the fixed effects ordered logit model. Journal of the Royal Statistical Society, Series A, 178(3), 685–703. doi:10.1111/rssa.12090
  • Das, M. & van Soest, A. (1999). A panel data model for subjective information on household income growth. Journal of Economic Behavior & Organization, 40(4), 409–426. doi:10.1016/S0167-2681(99)00062-4
  • Williams, R. (2006). Generalized ordered logit/partial proportional odds models for ordinal dependent variables. Stata Journal, 6(1), 58–82. doi:10.1177/1536867X0600600104
  • Ferrer-i-Carbonell, A. & Frijters, P. (2004). How important is methodology for the estimates of the determinants of happiness? Economic Journal, 114(497), 641–659. doi:10.1111/j.1468-0297.2004.00235.x
  • Carro, J.M. & Traferri, A. (2014). State dependence and heterogeneity in health using a bias-corrected fixed-effects estimator. Journal of Applied Econometrics, 29(2), 181–207. doi:10.1002/jae.2306
  • Muris, C., Raposo, P. & Vandoros, S. (2020). Ordered outcomes in a dynamic setting. Econometrics Journal, 23(1), 186–213. doi:10.1093/ectj/utaa003

Panel count models:

  • Hausman, J., Hall, B.H. & Griliches, Z. (1984). Econometric models for count data with an application to the patents-R&D relationship. Econometrica, 52(4), 909–938. doi:10.2307/1911191
  • Wooldridge, J.M. (1999). Distribution-free estimation of some nonlinear panel data models. Journal of Econometrics, 90(1), 77–97. doi:10.1016/S0304-4076(98)00033-5
  • Blundell, R., Griffith, R. & Windmeijer, F. (2002). Individual effects and dynamics in count data models. Journal of Econometrics, 108(1), 113–131. doi:10.1016/S0304-4076(01)00108-7
  • Allison, P.D. & Waterman, R.P. (2002). Fixed-effects negative binomial regression models. Sociological Methodology, 32(1), 247–265. doi:10.1111/1467-9531.00117
  • Cameron, A.C. & Trivedi, P.K. (1998). Regression Analysis of Count Data. Cambridge. doi:10.1017/CBO9780511814365
  • Windmeijer, F. (2000). Moment conditions for fixed effects count data models with endogenous regressors. Economics Letters, 68(1), 21–24. doi:10.1016/S0165-1765(00)00228-0
  • Winkelmann, R. (2000). Econometric Analysis of Count Data, 3rd ed. Springer. doi:10.1007/978-3-540-78389-3

Dynamics — foundational papers:

  • Cox, D.R. (1981). Statistical analysis of time series: Some recent developments. Scandinavian Journal of Statistics, 8(2), 93–115. JSTOR:4615819
  • Heckman, J.J. (1981a). Heterogeneity and state dependence. In S. Rosen (ed.), Studies in Labor Markets. NBER/University of Chicago Press.
  • Heckman, J.J. (1981b). The incidental parameters problem and the problem of initial conditions. In Manski & McFadden (eds.), Structural Analysis of Discrete Data. MIT Press.
  • Heckman, J.J. (1981c). Statistical models for discrete panel data. In Manski & McFadden (eds.), Structural Analysis of Discrete Data. MIT Press.
  • Wooldridge, J.M. (2005). Simple solutions to the initial conditions problem in dynamic, nonlinear panel data models with unobserved heterogeneity. Journal of Applied Econometrics, 20(1), 39–54. doi:10.1002/jae.770
  • Harvey, A.C. (2013). Dynamic Models for Volatility and Heavy Tails. Cambridge. doi:10.1017/CBO9781139540933
  • Creal, D., Koopman, S.J. & Lucas, A. (2013). Generalized autoregressive score models with applications. Journal of Applied Econometrics, 28(5), 777–795. doi:10.1002/jae.1279

Dynamic binary panel models:

  • Heckman, J.J. (1981b, c). See above.
  • Wooldridge, J.M. (2005). Simple solutions to the initial conditions problem. Journal of Applied Econometrics, 20(1), 39–54. doi:10.1002/jae.770
  • Honoré, B.E. & Kyriazidou, E. (2000). Panel data discrete choice models with lagged dependent variables. Econometrica, 68(4), 839–874. doi:10.1111/1468-0262.00139
  • Carro, J.M. (2007). Estimating dynamic panel data discrete choice models with fixed effects. Journal of Econometrics, 140(2), 503–528. doi:10.1016/j.jeconom.2006.07.023
  • Vella, F. & Verbeek, M. (1998). Whose wages do unions raise? Journal of Applied Econometrics, 13(2), 163–183. doi:10.1002/(SICI)1099-1255(199803/04)13:2<163::AID-JAE460>3.0.CO;2-Y
  • Chamberlain, G. (1993). Feedback in panel data models. Unpublished manuscript, Harvard University.
  • Stewart, M.B. (2007). The interrelated dynamics of unemployment and low-wage employment. Journal of Applied Econometrics, 22(3), 511–531. doi:10.1002/jae.922

Dynamic ordered panel models and human rights applications:

  • Walker, R.W. (2006). Democracy and human rights abuses: Insights from first-order Markov models. Working paper, Willamette University. PDF
  • Contoyannis, P., Jones, A.M. & Rice, N. (2004). The dynamics of health in the British Household Panel Survey. Journal of Applied Econometrics, 19(4), 473–503. doi:10.1002/jae.755
  • Müller, C., Raposo, P. & Vandoros, S. (2021). Dynamic ordered panel logit models. arXiv:2107.03253. arXiv
  • Albarran, P., Carrasco, R. & Carro, J.M. (2019). Estimation of dynamic nonlinear random effects models with unbalanced panels. Journal of Econometrics, 212(1), 271–296. doi:10.1016/j.jeconom.2019.04.028
  • Hill, D.W. & Jones, Z.M. (2014). An empirical evaluation of explanations for state repression. American Political Science Review, 108(3), 661–687. doi:10.1017/S0003055414000306
  • Schnakenberg, K.E. & Fariss, C.J. (2014). Dynamic patterns of human rights practices. Political Science Research and Methods, 2(1), 1–31. doi:10.1017/psrm.2013.15
  • Carro, J.M. & Traferri, A. (2014). State dependence and heterogeneity in health using a bias-corrected fixed-effects estimator. Journal of Applied Econometrics, 29(2), 181–207. doi:10.1002/jae.2306

Dynamic count models:

  • Harvey, A.C. & Fernandes, C. (1989). Time series models for count data. Journal of Time Series Analysis, 10(3), 211–220. doi:10.1111/j.1467-9892.1989.tb00024.x
  • Davis, R.A., Dunsmuir, W.T.M. & Streett, S.B. (2003). Observation-driven models for Poisson counts. Biometrika, 90(4), 777–790. doi:10.1093/biomet/90.4.777
  • Creal, D., Koopman, S.J. & Lucas, A. (2013). Generalized autoregressive score models with applications. Journal of Applied Econometrics, 28(5), 777–795. doi:10.1002/jae.1279
  • Blundell, R., Griffith, R. & Windmeijer, F. (2002). Individual effects and dynamics in count data models. Journal of Econometrics, 108(1), 113–131. doi:10.1016/S0304-4076(01)00108-7
  • Windmeijer, F. (2000). Moment conditions for fixed effects count data models with endogenous regressors. Economics Letters, 68(1), 21–24. doi:10.1016/S0165-1765(00)00228-0
  • Ahn, J.Y., Jeong, H., Lu, Y. & Wüthrich, M.V. (2023). A classification of observation-driven state-space count models for panel data. arXiv:2308.16058. arXiv
  • tscount R package: CRAN

Simulation estimation methods:

  • Keane, M.P. (1994). A computationally practical simulation estimator for panel data. Econometrica, 62(1), 95–116. doi:10.2307/2951567
  • Hajivassiliou, V.A. & Ruud, P.A. (1994). Classical estimation methods for LDV models using simulation. In R.F. Engle & D.L. McFadden (eds.), Handbook of Econometrics, Vol. 4, pp. 2383–2441. North-Holland.
  • Geweke, J. (1991). Efficient simulation from the multivariate normal and Student-t distributions subject to linear constraints. Computing Science and Statistics, 571–578.
  • Gourieroux, C. & Monfort, A. (1994). Simulation-based inference: A survey with special reference to panel data. Journal of Econometrics, 59(1–2), 5–33. doi:10.1016/0304-4076(94)90037-X
  • McFadden, D. & Train, K. (2000). Mixed MNL models for discrete response. Journal of Applied Econometrics, 15(5), 447–470. doi:10.1002/1099-1255(200009/10)15:5<447::AID-JAE570>3.0.CO;2-1

Censored and truncated panel data:

  • Heckman, J.J. & MaCurdy, T. (1980). A life-cycle model of female labour supply. Review of Economic Studies, 47(1), 47–74. doi:10.2307/2297103
  • Honoré, B.E. (1992). Trimmed LAD and least squares estimation of truncated and censored regression models with fixed effects. Econometrica, 60(3), 533–565. doi:10.2307/2951583
  • Honoré, B.E. (1993). Orthogonality conditions for Tobit models with fixed effects and lagged dependent variables. Journal of Econometrics, 59(1–2), 35–61. doi:10.1016/0304-4076(93)90042-K
  • Kyriazidou, E. (1997). Estimation of a panel data sample selection model. Econometrica, 65(6), 1335–1364. doi:10.2307/2171739
  • Greene, W.H. (2004b). Fixed effects and bias due to the incidental parameters problem in the Tobit model. Econometric Reviews, 23(2), 125–147. doi:10.1081/ETC-120039606
  • Honoré, B.E. & Kyriazidou, E. (2000a). Estimation of Tobit-type models with individual specific effects. Econometric Reviews, 19(3), 341–366. doi:10.1080/07474930008800475

Selection bias and attrition in panels:

  • Hausman, J.A. & Wise, D.A. (1979). Attrition bias in experimental and panel data. Econometrica, 47(2), 455–473. doi:10.2307/1914193
  • Verbeek, M. & Nijman, T. (1992a). Testing for selectivity bias in panel data models. International Economic Review, 33(3), 681–703. doi:10.2307/2527139
  • Verbeek, M. & Nijman, T. (1996). Incomplete panels and selection bias. In L. Mátyás & P. Sevestre (eds.), The Econometrics of Panel Data, 2nd ed. Kluwer.
  • Wooldridge, J.M. (1995). Selection corrections for panel data models under conditional mean independence assumptions. Journal of Econometrics, 68(1), 115–132. doi:10.1016/0304-4076(94)01645-G
  • Heckman, J.J. (1979). Sample selection bias as a specification error. Econometrica, 47(1), 153–161. doi:10.2307/1912352
  • Nijman, T. & Verbeek, M. (1992). Nonresponse in panel data: The impact on estimates of a life-cycle consumption function. Journal of Applied Econometrics, 7(3), 243–257. doi:10.1002/jae.3950070303
  • Ridder, G. (1990). Attrition in multi-wave panel data. In J. Hartog, G. Ridder & J. Theeuwes (eds.), Panel Data and Labour Market Studies. North-Holland.

Nurses’ labour supply and related applications:

  • Askildsen, J.E., Baltagi, B.H. & Holmås, T.H. (2003). Wage policy in the health care sector: A panel data analysis of nurses’ labour supply. Health Economics, 12(9), 705–719. doi:10.1002/hec.770
  • Kyriazidou, E. (1997). Estimation of a panel data sample selection model. Econometrica, 65(6), 1335–1364. doi:10.2307/2171739
  • Vella, F. & Verbeek, M. (1998). Whose wages do unions raise? Journal of Applied Econometrics, 13(2), 163–183. doi:10.1002/(SICI)1099-1255(199803/04)13:2<163::AID-JAE460>3.0.CO;2-Y
  • Sickles, R. & Taubman, P. (1986). An analysis of the health and retirement status of the elderly. Econometrica, 54(6), 1339–1356. doi:10.2307/1914302
  • Bjørklund, A. (1985). Unemployment and mental health: Some evidence from panel data. Journal of Human Resources, 20(4), 469–483. doi:10.2307/145878

Software documentation and packages:

  • Stata: xtlogit, xtprobit, xtpoisson, xtnbreg, xttobit, xtoprobitStata 18 Longitudinal/Panel Data Reference Manual. stata.com
  • R fixest: Bergé, L. (2018). Efficient estimation of maximum likelihood models with multiple fixed-effects. Econometrics Journal, 21(3), 388–408. doi:10.1111/ectj.12101 | Package
  • R lme4: Bates et al. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1). doi:10.18637/jss.v067.i01 | Package
  • R ordinal: Christensen, R.H.B. (2019). ordinal — Regression models for ordinal data. Package
  • R pglm: Croissant, Y. (2020). pglm: Panel generalised linear models. Package
  • R marginaleffects: Arel-Bundock et al. (2024). Journal of Statistical Software, 111(9). doi:10.18637/jss.v111.i09 | Website
  • R tscount: Liboschik et al. (2017). tscount: An R package for analysis of count time series following generalized linear models. Journal of Statistical Software, 82(5). doi:10.18637/jss.v082.i05 | Package
  • R censReg: Henningsen, A. (2010). Estimating censored regression models in R using the censReg package. Package
  • R clubSandwich: Pustejovsky, J.E. (2015). Cluster-robust variance estimation. Package
  • BUC estimator: ssc install buc in Stata; code accompanying Baetschmann et al. (2015)
  • Honoré estimator: ssc install honor in Stata; author’s page

Frontiers and synthesis:

  • Honoré, B.E. & Tamer, E. (2006). Bounds on parameters in panel dynamic discrete choice models. Econometrica, 74(3), 611–629. doi:10.1111/j.1468-0262.2006.00687.x
  • Müller, C., Raposo, P. & Vandoros, S. (2021). Dynamic ordered panel logit models. arXiv:2107.03253. arXiv
  • Hasegawa, H. (2009). Bayesian dynamic panel-ordered probit model and its application to subjective well-being. Communications in Statistics: Simulation and Computation, 38(6), 1321–1347. doi:10.1080/03610910902939530
  • Schnakenberg, K.E. & Fariss, C.J. (2014). Dynamic patterns of human rights practices. Political Science Research and Methods, 2(1), 1–31. doi:10.1017/psrm.2013.15
  • Wooldridge, J.M. (2019). Correlated random effects models with unbalanced panels. Journal of Econometrics, 211(1), 137–150. doi:10.1016/j.jeconom.2018.12.010
  • Arel-Bundock, V., Greifer, N. & Heiss, A. (2024). How to interpret statistical models using marginaleffects for R and Python. Journal of Statistical Software, 111(9). doi:10.18637/jss.v111.i09
  • Bergé, L. (2018). Efficient estimation of maximum likelihood models with multiple fixed-effects. Econometrics Journal, 21(3), 388–408. doi:10.1111/ectj.12101 | fixest
  • Walker, R.W. (2016). Generalising the cumulative ordered regression model. Journal of Modern Applied Statistical Methods, 15(1). doi:10.22237/jmasm/1462076280