Advanced search
Publication Cover
Technometrics Volume 37, 1995 - Issue 4
Submit an article Journal homepage
645
Views
508
CrossRef citations to date
0
Altmetric
Original Articles

Better Subset Regression Using the Nonnegative Garrote

Leo Breiman Statistics Department, University of California Berkeley, Berkeley, CA, 94720
Pages 373-384 | Published online: 12 Mar 2012
 
Sample our Engineering & Technology journals, sign in here to start your access, latest two full volumes FREE to you for 14 days

Abstract

A new method, called the nonnegative (nn) garrote, is proposed for doing subset regression. It both shrinks and zeroes coefficients. In tests on real and simulated data, it produces lower prediction error than ordinary subset selection. It is also compared to ridge regression. If the regression equations generated by a procedure do not change drastically with small changes in the data, the procedure is called stable. Subset selection is unstable, ridge is very stable, and the nn-garrote is intermediate. Simulation results illustrate the effects of instability on prediction error.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related Research Data

Comparative Study on Variable Selection Approaches in Establishment of Remote Sensing Model for Forest Biomass Estimation
Source: Multidisciplinary Digital Publishing Institute
Variable selection for spatial autoregressive models with a diverging number of parameters
Source: Springer Science and Business Media LLC
Genomic Selection for Crop Improvement
Source: Wiley
High-Dimensional LASSO-Based Computational Regression Models: Regularization, Shrinkage, and Selection
Source: MDPI AG
Post-Fisherian Experimentation: From Physical to Virtual
Source: Informa UK Limited
Estimating Optimal Transformations for Multiple Regression and Correlation.
Source: Informa UK Limited
Model boosting for spatial weighting matrix selection in spatial lag models
Source: SAGE Publications
Analysis of Anthropogenic, Climatological, and Morphological Influences on Dissolved Organic Matter in Rocky Mountain Streams
Source: Multidisciplinary Digital Publishing Institute
Variable selection of varying dispersion student-t regression models
Source: Springer Science and Business Media LLC
Bayesian adaptive Lasso for quantile regression models with nonignorably missing response data
Source: Informa UK Limited
Some Comments on C P
Source: JSTOR
Screening Strategies in the Presence of Interactions
Source: Informa UK Limited
Supervised subgraph augmented non-negative matrix factorization for interpretable manufacturing time series data analytics
Source: Taylor & Francis
Logistic regression for crystal growth process modeling through hierarchical nonnegative garrote-based variable selection
Source: Informa UK Limited
Split Regularized Regression
Source: Informa UK Limited
Sufficient Dimension Reduction for Tensor Data
Source: Springer International Publishing
Significance Controlled Variable Selection
Source: Wiley
Denoising scheme based on singular-value decomposition for one-dimensional spectra and its application in precision storage-ring mass spectrometry.
Source: arXiv
Genomic Prediction of Breeding Values Using a Subset of SNPs Identified by Three Machine Learning Methods.
Source: Frontiers Media SA
A simulation of biased estimation and subset selection regression techniques
Source: JSTOR
Quantile regression for robust estimation and variable selection in partially linear varying-coefficient models
Source: Informa UK Limited
Regression Shrinkage and Selection via the Lasso
Source: Wiley
Robust identification of target genes and outliers in triple-negative breast cancer data
Source: SAGE Publications
Exploring Partial Residual Plots
Source: Informa UK Limited
In Search of a Sensible Strategy in Small Data Sets
Source: SAGE Publications
Variable selection in elliptical linear mixed model
Source: Informa UK Limited
A continuous differentiable wavelet threshold function for speech enhancement
Source: Springer Science and Business Media LLC
Prediction Error and Its Estimation for Subset-Selected Models
Source: Informa UK Limited
Optimal regression parameter-specific shrinkage by plug-in estimation
Source: Informa UK Limited
Group variable selection via SCAD-L2
Source: Informa UK Limited
An Improved Prediction of Indian Summer Monsoon Onset From State‐of‐the‐Art Dynamic Model Using Physics‐Guided Data‐Driven Approach
Source: American Geophysical Union (AGU)
Bayesian Mode Regression
Source: Informa UK Limited
Variable Selection in Additive Models Using P-Splines
Source: HAL CCSD
Variable Selection for Nonparametric Learning with Power Series Kernels.
Source: MIT Press - Journals
A Continuous Differentiable Wavelet Shrinkage Function for Economic Data Denoising
Source: Springer Science and Business Media LLC
Sparse Penalized Forward Selection for Support Vector Classification
Source: Informa UK Limited
Robust variable screening for regression using factor profiling
Source: arXiv
Conditional SIRS for nonparametric and semiparametric models by marginal empirical likelihood
Source: Springer Science and Business Media LLC
Estimation of Directed Acyclic Graphs Through Two-Stage Adaptive Lasso for Gene Network Inference
Source: Informa UK Limited
Variable Selection in Varying-Coefficient Models Using P-Splines
Source: HAL CCSD
Nonnegative estimation and variable selection under minimax concave penalty for sparse high-dimensional linear regression models
Source: Springer Science and Business Media LLC
Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter
Source: Informa UK Limited
Learning class-specific dictionaries for digit recognition from spherical surface of a 3D ball
Source: Springer Science and Business Media LLC
An active set Barzilar–Borwein algorithm for $$l_{0}$$l0 regularized optimization
Source: Springer Science and Business Media LLC
Variable selection with Group LASSO approach: Application to Cox regression with frailty model.
Source: Informa UK Limited
Image compressed sensing recovery via nonconvex garrote regularization
Source: Springer Science and Business Media LLC
Machine Learning, Dynamical Systems, and Control
Source: Cambridge University Press
A sparse partitioned-regression model for nonlinear system-environment interactions
Source: Taylor & Francis
FLEXIBLE PARSIMONIOUS SMOOTHING AND ADDITIVE MODELING
Source: Informa UK Limited
Orthogonalizing EM: A Design-Based Least Squares Algorithm
Source: Informa UK Limited
Independence screening for high dimensional nonlinear additive ODE models with applications to dynamic gene regulatory networks
Source: Wiley
Trace Pursuit: A General Framework for Model-Free Variable Selection
Source: Informa UK Limited
Submodel selection and evaluation in regression. The X-random case
Source: JSTOR
New Insights on the Optimality Conditions of the l2-l0 Minimization Problem
Source: Springer Science and Business Media LLC
A Statistical View of Some Chemometrics Regression Tools
Source: Informa UK Limited
Subset Selection in Regression
Source: Springer US
A Statistical View of Some Chemometrics Regression Tools
Source: Informa UK Limited
A Critique of Some Ridge Regression Methods
Source: Informa UK Limited
The Little Bootstrap and other Methods for Dimensionality Selection in Regression: X-Fixed Prediction Error
Source: Informa UK Limited

Linking provided by 

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.