Details

Autor(en) / Beteiligte

• Loh, Po-Ling
• Wainwright, Martin J.

Titel

SUPPORT RECOVERY WITHOUT INCOHERENCE: A CASE FOR NONCONVEX REGULARIZATION

Ist Teil von

• The Annals of statistics, 2017-12, Vol.45 (6), p.2455-2482

Ort / Verlag

Hayward: Institute of Mathematical Statistics

Erscheinungsjahr

2017

Quelle

Alma/SFX Local Collection

Beschreibungen/Notizen

• We develop a new primal-dual witness proof framework that may be used to establish variable selection consistency and ℓ∞-bounds for sparse regression problems, even when the loss function and regularizer are nonconvex. We use this method to prove two theorems concerning support recovery and ℓ∞-guarantees for a regression estimator in a general setting. Notably, our theory applies to all potential stationary points of the objective and certifies that the stationary point is unique under mild conditions. Our results provide a strong theoretical justification for the use of nonconvex regularization: For certain nonconvex regularizers with vanishing derivative away from the origin, any stationary point can be used to recover the support without requiring the typical incoherence conditions present in ℓ1-based methods. We also derive corollaries illustrating the implications of our theorems for composite objective functions involving losses such as least squares, nonconvex modified least squares for errors-in-variables linear regression, the negative log likelihood for generalized linear models and the graphical Lasso. We conclude with empirical studies that corroborate our theoretical predictions.