Jump to ContentJump to Main Navigation
Show Summary Details
In This Section

Statistics & Risk Modeling

with Applications in Finance and Insurance

Editor-in-Chief: Stelzer, Robert

4 Issues per year

Cite Score 2016: 0.33

Mathematical Citation (MCQ) Quotient 2015: 0.29

See all formats and pricing
In This Section
Volume 24, Issue 3 (Dec 2006)


The cross-validated adaptive epsilon-net estimator

Mark J. van der Laan / Sandrine Dudoit / Aad W. van der Vaart
Published Online: 2009-09-25 | DOI: https://doi.org/10.1524/stnd.2006.24.3.373

Suppose that we observe a sample of independent and identically distributed realizations of a random variable, and a parameter of interest can be defined as the minimizer, over a suitably defined parameter set, of the expectation of a (loss) function of a candidate parameter value and the random variable. For example, squared error loss in regression or the negative log-density loss in density estimation. Minimizing the empirical risk (i.e., the empirical mean of the loss function) over the entire parameter set may result in ill-defined or too variable estimators of the parameter of interest. In this article, we propose a cross-validated ε-net estimation method, which uses a collection of submodels and a collection of ε-nets over each submodel. For each submodel s and each resolution level ε, the minimizer of the empirical risk over the corresponding ε-net is a candidate estimator. Next we select from these estimators (i.e. select the pair (s,ε)) by multi-fold cross-validation. We derive a finite sample inequality that shows that the resulting estimator is as good as an oracle estimator that uses the best submodel and resolution level for the unknown true parameter. We also address the implementation of the estimation procedure, and in the context of a linear regression model we present results of a preliminary simulation study comparing the cross-validated ε-net estimator to the cross-validated L1-penalized least squares estimator (LASSO) and the least angle regression estimator (LARS).

Keywords: adaptation; covering number; cross-validation; loss function; maximum likelihood estimation

About the article

Received: 2004-03-11

Accepted: 2006-09-06

Published Online: 2009-09-25

Published in Print: 2006-12-01

Citation Information: Statistics & Decisions, ISSN (Print) 0721-2631, DOI: https://doi.org/10.1524/stnd.2006.24.3.373. Export Citation

Citing Articles

Here you can find all Crossref-listed publications in which this article is cited. If you would like to receive automatic email messages as soon as this article is cited in other publications, simply activate the “Citation Alert” on the top of this page.

Romain Neugebauer, Julie A. Schmittdiel, Zheng Zhu, Jeremy A. Rassen, John D. Seeger, and Sebastian Schneeweiss
Statistics in Medicine, 2015, Volume 34, Number 5, Page 753
Mark J. van der Laan and Richard J. C. M. Starmans
Advances in Statistics, 2014, Volume 2014, Page 1
Romain Neugebauer, Julie A. Schmittdiel, and Mark J. van der Laan
Statistics in Medicine, 2014, Volume 33, Number 14, Page 2480
Hui Wang and Mark J van der Laan
BMC Bioinformatics, 2011, Volume 12, Number 1, Page 312

Comments (0)

Please log in or register to comment.
Log in