Performance Comparison of SIMEX and Regression Calibration for Measurement Error Correction in Nonparametric Regression
DOI:
https://doi.org/10.65405/45x30y52Keywords:
Nonparametric regression; Nadaraya–Watson estimator; Classical measurement error; Simulation-Extrapolation (SIMEX); Regression Calibration (RC); Monte Carlo simulationAbstract
It is well established that measurement errors in explanatory variables can result in severe attenuation bias and over-smoothing in nonparametric kernel estimation. This study compares two prominent measurement error correction procedures Simulation-Extrapolation (SIMEX) using quadratic extrapolation and Regression Calibration (RC) against the standard, uncorrected Nadaraya–Watson (NW) estimator under classical additive error. A Monte Carlo simulation study was conducted across three sample sizes (n = 100, 200, 500) and three error variance levels ( = 0.1, 0.3, 0.5) applied to a non-linear target curve. Estimator performance was evaluated using Mean Squared Error (MSE), Mean Absolute Error (MAE) and Bias. The findings reveal a clear, complementary performance pattern supported by empirical evidence: SIMEX optimally reduces bias and MAE under low error variance ( = 0.1), achieving significant reductions in MSE compared to the uncorrected estimator, ranging from 18.1% at n = 100, to 24.0% at n = 200, and reaching up to 36.1% at n = 500. Furthermore, SIMEX reduces MAE by up to 21.0% in large sample sizes under low noise. Conversely, Regression Calibration (RC) exhibits superior stability and consistently lower overall MSE and MAE at moderate-to-severe error levels ( 0.3), offering MSE reductions of 10.3% to 14.4% across sample sizes, while avoiding the variance inflation and performance degradation inherent in SIMEX's quadratic extrapolation step under high noise. These empirical results demonstrate that selecting the optimal error correction method depends directly on the measurement error magnitude and the targeted performance metric.
Downloads
References
Carroll, R. J., Delaigle, A., & Hall, P. (2009). Nonparametric prediction in measurement error models. Journal of the American Statistical Association, 104(487), 993–1003. https://doi.org/10.1198/jasa.2009.tm07543
Carroll, R. J., Maca, J. D., & Ruppert, D. (1999). Nonparametric regression in the presence of measurement error. Biometrika, 86(3), 541–554. https://doi.org/10.1093/biomet/86.3.541
Carroll, R. J., Ruppert, D., Stefanski, L. A., & Crainiceanu, C. M. (2006). Measurement error in nonlinear models: A modern perspective (2nd ed.). Chapman & Hall/CRC.
Cook, J. R., & Stefanski, L. A. (1994). Simulation-extrapolation estimation in parametric measurement error models. Journal of the American Statistical Association, 89(428), 1314–1328. https://doi.org/10.1080/01621459.1994.10476871
Fuller, W. A. (1987). Measurement error models. Wiley.
Keogh, R. H., Shaw, P. A., Gustafson, P., Carroll, R. J., Deffner, V., Dodd, K. W., Küchenhoff, H., Tooze, J. A., Wallace, M. P., Kipnis, V., & Freedman, L. S. (2020). STRATOS guidance document on measurement error and misclassification of variables in observational epidemiology: Part 1—Basic theory and simple methods of adjustment. Statistics in Medicine, 39(16), 2197–2231. https://doi.org/10.1002/sim.8532
Sevilimedu, V., & Yu, L. (2022). Simulation extrapolation method for measurement error: A review. Statistical Methods in Medical Research, 31(8), 1617–1636. https://doi.org/10.1177/09622802221102619











