An efficient stochastic generalized method of moments estimator for nonlinear moment models

Source abstract

We study the asymptotic properties of the nonlinear stochastic GMM algorithm proposed by Chen, Lee, Liao, Seo, Shin and Song for recursively estimating parameters defined by possibly nonlinear and overidentified moment restrictions $\E[g(X,β^*)]=0$. Each observation updates estimates of the moment Jacobian, inverse covariance matrix and Gauss--Newton preconditioner at a cost independent of sample size. For linear and nonlinear instrumental-variable moments, we derive an exact rank-two Sherman--Morrison--Woodbury update. The algorithm combines preconditioned stochastic approximation with iterate averaging. Under a preconditioned monotonicity condition, satisfied globally in linear models and locally around a consistent pilot estimate in general, we establish almost sure convergence and rates, as well as a functional central limit theorem with the efficient GMM variance. These results require four moments of the moment function and its Jacobian when the step exponent exceeds $2/3$. The inverse Gauss--Newton matrix consistently estimates this variance, and a projected linearised statistic enables online testing of overidentifying restrictions. We extend the results to $L$-dependent data with long-run variance weights under stronger moment assumptions. Simulations show that the averaged estimator approaches offline two-step GMM in accuracy and coverage at $10^6$ observations, while requiring a fraction of its computing time and fixed memory at up to $10^7$ observations. The online test achieves correct size and comparable power. In an application estimating the effect of a third child on weeks worked using $254{,}654$ women from the 1980 US Census, single-pass estimates agree with offline GMM within a fraction of a standard error on average across data orderings, and both methods yield the same overidentification-test conclusion in most orderings.