
glmnet
 Referenced in 238 articles
[sw08159]
 grouped multinomial. The algorithm uses cyclical coordinate descent in a pathwise fashion, as described...

CG_DESCENT
 Referenced in 81 articles
[sw04813]
 Algorithm 851: CG_DESCENT. A conjugate gradient method with guaranteed descent Recently, a new nonlinear ... gradient scheme was developed which satisfies the descent condition gTkdk ≤ −7/8 ‖gk‖2 and which ... article studies the convergence behavior of the algorithm; extensive numerical tests and comparisons with other...

Pegasos
 Referenced in 67 articles
[sw08752]
 simple and effective stochastic subgradient descent algorithm for solving the optimization problem cast ... contrast, previous analyses of stochastic gradient descent methods for SVMs require Ω(1/ϵ2) iterations ... size of the training set, the resulting algorithm is especially suited for learning from large...

glasso
 Referenced in 251 articles
[sw07432]
 primal algorithms pglasso and dpglasso, that also operate by blockcoordinate descent, where...

mboost
 Referenced in 48 articles
[sw07331]
 mboost: ModelBased Boosting. Functional gradient descent algorithm (boosting) for optimizing general risk functions utilizing...

LASSO
 Referenced in 27 articles
[sw02850]
 gradient descent algorithm for LASSO LASSO is a useful method to achieve the shrinkage...

SGDQN
 Referenced in 15 articles
[sw19411]
 algorithm is a stochastic gradient descent algorithm that makes careful use of secondorder information ... gradient descent but requires less iterations to achieve the same accuracy. This algorithm...

BADMM
 Referenced in 16 articles
[sw20288]
 Direction Method of Multipliers. The mirror descent algorithm (MDA) generalizes gradient descent by using...

levmar
 Referenced in 43 articles
[sw04809]
 variants are included. The LevenbergMarquardt (LM) algorithm is an iterative technique that finds ... thought of as a combination of steepest descent and the GaussNewton method. When ... correct one, the algorithm behaves like a steepest descent method: slow, but guaranteed to converge...

sparsenet
 Referenced in 52 articles
[sw19133]
 package SparseNet: coordinate descent with nonconvex penalties. We address the problem of sparse selection ... convexrelaxation algorithms for finding good solutions. We pursue a coordinatedescent approach for optimization ... standardizing reparametrization that assists our pathwise algorithm. The MC+ penalty is ideally suited to this...

TIGRA
 Referenced in 34 articles
[sw02333]
 TIGRA (Tikhonovgradient method) algorithm proposed uses steepest descent iterations in an inner loop...

HOGWILD
 Referenced in 31 articles
[sw28396]
 Gradient Descent. Stochastic Gradient Descent (SGD) is a popular algorithm that can achieve state...

QICD
 Referenced in 5 articles
[sw19679]
 Extremely fast algorithm ”QICD”, Iterative Coordinate Descent Algorithm for Highdimensional Nonconvex Penalized Quantile Regression ... This algorithm combines the coordinate descent algorithm in the inner iteration with the majorization minimization...

Optspace
 Referenced in 7 articles
[sw12630]
 Optspace: A Gradient Descent Algorithm on the Grassmann Manifold for Matrix Completion. We consider...

APPLE
 Referenced in 4 articles
[sw13354]
 variable selection and parameter estimation. A new algorithm, APPLE, is proposed for calculating the Approximate ... predictorcorrector method and the coordinatedescent algorithm. APPLE is compared with several wellknown...

GOP
 Referenced in 5 articles
[sw17432]
 implemented for various particular core optimization algorithms: Steepest Descent, HeavyBall, Genetic Algorithm, Differential Evolution...

cvplogistic
 Referenced in 3 articles
[sw29394]
 Model using Majorization Minimization by Coordinate Descent (MMCD) Algorithm. The package uses majorization minimization ... coordinate descent (MMCD) algorithm to compute the solution surface for concave penalized logistic regression model...

ChainSAT
 Referenced in 6 articles
[sw09444]
 Circumspect descent prevails in solving random constraint satisfaction problems. We study the performance of stochastic ... local search algorithms for random instances of the Ksatisfiability (KSAT) problem. We present...

topopt_multi
 Referenced in 7 articles
[sw25723]
 regularized projected steepest descent method. A new computational algorithm is introduced in the present study ... functional by a fractional step projected steepest descent method. In the first step ... found based on the projected steepest descent method to ensure the reduction in the objective ... control constraints. The presented algorithm could be accounted as a constrained $H^1$ optimization algorithm...

dglars
 Referenced in 2 articles
[sw23497]
 predictorcorrector or a cyclic coordinate descent algorithm, as described in the paper linked...