
CGS
 Referenced in 301 articles
[sw08225]
 algorithm (a “squared” conjugate gradient method) with a preconditioning called ILLU (an incomplete line...

LSQR
 Referenced in 358 articles
[sw00530]
 analytically equivalent to the standard method of conjugate gradients, but possesses more favorable numerical properties ... method, subroutine LSQR. Numerical tests are described comparing LSQR with several other conjugategradient algorithms...

lobpcg.m
 Referenced in 120 articles
[sw24008]
 locally optimal block preconditioned conjugate gradient method: Toward the optimal preconditioned eigensolver: Locally optimal block ... preconditioned conjugate gradient method. We describe new algorithms of the locally optimal block preconditioned conjugate ... gradient (LOBPCG) method for symmetric eigenvalue problems, based on a local optimization of a three ... advocate the standard preconditioned conjugate gradient method for finding an eigenvector as an element...

tn
 Referenced in 130 articles
[sw05140]
 linear conjugategradient method (developed via the Lanczos method) in the solution of largescale ... Lanczos characterization of the linear conjugategradient method may be exploited to define a modified ... iterations earlier. A preconditioned truncated Newton method is described that defines a search direction which ... direction defined by a nonlinear conjugategradienttype method and a modified Newton direction. Numerical...

KELLEY
 Referenced in 600 articles
[sw04829]
 chapters conclude with a demonstration of the methods discussed in the respective chapter using ... cases the noise often introduces artificial minimizers. Gradient information, even if available, cannot expected ... group. Implicit filtering methods use finite difference approximations of the gradient, which are adjusted ... conclude with a numerical demonstration of the methods discussed in the respective chapter, and with...

TRON
 Referenced in 109 articles
[sw04714]
 constrained optimization problems. TRON uses a gradient projection method to generate ... Cauchy step, a preconditioned conjugate gradient method with an incomplete Cholesky factorization to generate...

BiCGstab
 Referenced in 122 articles
[sw04022]
 BiCGstab(l) of the biconjugate gradient method for the solution of a system...

Adam
 Referenced in 273 articles
[sw22205]
 Method for Stochastic Optimization. We introduce Adam, an algorithm for firstorder gradientbased optimization ... adaptive estimates of lowerorder moments. The method is straightforward to implement, is computationally efficient ... invariant to diagonal rescaling of the gradients, and is well suited for problems that ... terms of data and/or parameters. The method is also appropriate for nonstationary objectives...

CG_DESCENT
 Referenced in 105 articles
[sw04813]
 Algorithm 851: CG_DESCENT. A conjugate gradient method with guaranteed descent Recently, a new nonlinear ... conjugate gradient scheme was developed which satisfies the descent condition gTkdk ... extensive numerical tests and comparisons with other methods for largescale unconstrained optimization are given...

SPGL1
 Referenced in 159 articles
[sw08365]
 domain. At each iteration, a spectral gradientprojection method approximately minimizes a leastsquares problem...

SPG
 Referenced in 70 articles
[sw00897]
 implementing the SPG method is introduced. SPG is a nonmonotone projected gradient algorithm for solving ... problems. It combines the classical projected gradient method with the spectral gradient choice of steplength...

Pegasos
 Referenced in 94 articles
[sw08752]
 contrast, previous analyses of stochastic gradient descent methods for SVMs require Ω(1/ϵ2) iterations...

GENSMAC
 Referenced in 60 articles
[sw07093]
 equations are solved by a finite difference method; the fluid surface is represented ... surface are accurately imposed; the conjugate gradient method is employed for solving the discrete Poisson...

TIGRA
 Referenced in 39 articles
[sw02333]
 combination of Tikhonov regularization and the gradient method for solving nonlinear illposed problems ... presented. The TIGRA (Tikhonovgradient method) algorithm proposed uses steepest descent iterations in an inner...

YSMP
 Referenced in 72 articles
[sw17947]
 sparse. The current release features direct methods based on Gaussian elimination without pivoting ... include a number of preconditioned conjugategradientlike methods as described in Section...

NeNMF
 Referenced in 30 articles
[sw17586]
 NeNMF: An optimal gradient method for nonnegative matrix factorization. Nonnegative matrix factorization ... multiplicative update rule (MUR), the projected gradient method (PG), the projected nonnegative least squares (PNLS ... active set method (AS). However, they suffer from one or some of the following three ... problems. It applies Nesterov’s optimal gradient method to alternatively optimize one factor with another...

AdaGrad
 Referenced in 97 articles
[sw22202]
 ADAGRAD: adaptive gradient algorithm; Adaptive subgradient methods for online learning and stochastic optimization. We present ... family of subgradient methods that dynamically incorporate knowledge of the geometry of the data observed ... earlier iterations to perform more informative gradientbased learning. Metaphorically, the adaptation allows ... which employ proximal functions to control the gradient steps of the algorithm. We describe...

NESUN
 Referenced in 31 articles
[sw28733]
 NESUN  Nesterov’s universal gradient method: Universal gradient methods for convex optimization problems. In this...

iPiano
 Referenced in 45 articles
[sw09623]
 nonsmooth split version of the Heavyball method from Polyak. A rigorous analysis ... prove convergence for several other gradient methods. First, an abstract convergence theorem for a generic...

PDNET
 Referenced in 39 articles
[sw04752]
 primalinfeasible dualfeasible network interior point method The authors introduce the truncated primalinfeasible ... implementation, a preconditioned conjugate gradient method is used as the iterative solver. The details...