g.ridge: An R Package for Generalized Ridge Regression for Sparse and High-Dimensional Linear Models

Takeshi Emura*, Koutarou Matsumoto, Ryuji Uozumi, Hirofumi Michimae

*Corresponding author for this work

Research output: Contribution to journalJournal Article peer-review

Abstract

Ridge regression is one of the most popular shrinkage estimation methods for linear models. Ridge regression effectively estimates regression coefficients in the presence of high-dimensional regressors. Recently, a generalized ridge estimator was suggested that involved generalizing the uniform shrinkage of ridge regression to non-uniform shrinkage; this was shown to perform well in sparse and high-dimensional linear models. In this paper, we introduce our newly developed R package “g.ridge” (first version published on 7 December 2023) that implements both the ridge estimator and generalized ridge estimator. The package is equipped with generalized cross-validation for the automatic estimation of shrinkage parameters. The package also includes a convenient tool for generating a design matrix. By simulations, we test the performance of the R package under sparse and high-dimensional settings with normal and skew-normal error distributions. From the simulation results, we conclude that the generalized ridge estimator is superior to the benchmark ridge estimator based on the R package “glmnet”. Hence the generalized ridge estimator may be the most recommended estimator for sparse and high-dimensional models. We demonstrate the package using intracerebral hemorrhage data.

Original languageEnglish
Article number223
JournalSymmetry
Volume16
Issue number2
DOIs
StatePublished - 02 2024
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2024 by the authors.

Keywords

  • R package
  • cross-validation
  • high-dimensional data
  • intracerebral hemorrhage
  • least squares estimator
  • mean square error
  • penalized regression
  • shrinkage estimator
  • sparse model

Fingerprint

Dive into the research topics of 'g.ridge: An R Package for Generalized Ridge Regression for Sparse and High-Dimensional Linear Models'. Together they form a unique fingerprint.

Cite this