• CGS

  • Referenced in 298 articles [sw08225]
  • algorithm (a “squared” conjugate gradient method) with a preconditioning called ILLU (an incomplete line...
  • LSQR

  • Referenced in 351 articles [sw00530]
  • analytically equivalent to the standard method of conjugate gradients, but possesses more favorable numerical properties ... method, subroutine LSQR. Numerical tests are described comparing LSQR with several other conjugate-gradient algorithms...
  • lobpcg.m

  • Referenced in 118 articles [sw24008]
  • locally optimal block preconditioned conjugate gradient method: Toward the optimal preconditioned eigensolver: Locally optimal block ... preconditioned conjugate gradient method. We describe new algorithms of the locally optimal block preconditioned conjugate ... gradient (LOBPCG) method for symmetric eigenvalue problems, based on a local optimization of a three ... advocate the standard preconditioned conjugate gradient method for finding an eigenvector as an element...
  • tn

  • Referenced in 126 articles [sw05140]
  • linear conjugate-gradient method (developed via the Lanczos method) in the solution of large-scale ... Lanczos characterization of the linear conjugate-gradient method may be exploited to define a modified ... iterations earlier. A preconditioned truncated Newton method is described that defines a search direction which ... direction defined by a nonlinear conjugate-gradient-type method and a modified Newton direction. Numerical...
  • KELLEY

  • Referenced in 592 articles [sw04829]
  • chapters conclude with a demonstration of the methods discussed in the respective chapter using ... cases the noise often introduces artificial minimizers. Gradient information, even if available, cannot expected ... group. Implicit filtering methods use finite difference approximations of the gradient, which are adjusted ... conclude with a numerical demonstration of the methods discussed in the respective chapter, and with...
  • TRON

  • Referenced in 108 articles [sw04714]
  • constrained optimization problems. TRON uses a gradient projection method to generate ... Cauchy step, a preconditioned conjugate gradient method with an incomplete Cholesky factorization to generate...
  • BiCGstab

  • Referenced in 120 articles [sw04022]
  • BiCGstab(l) of the bi-conjugate gradient method for the solution of a system...
  • CG_DESCENT

  • Referenced in 101 articles [sw04813]
  • Algorithm 851: CG_DESCENT. A conjugate gradient method with guaranteed descent Recently, a new nonlinear ... conjugate gradient scheme was developed which satisfies the descent condition gTkdk ... extensive numerical tests and comparisons with other methods for large-scale unconstrained optimization are given...
  • SPGL1

  • Referenced in 155 articles [sw08365]
  • domain. At each iteration, a spectral gradient-projection method approximately minimizes a least-squares problem...
  • Adam

  • Referenced in 218 articles [sw22205]
  • Method for Stochastic Optimization. We introduce Adam, an algorithm for first-order gradient-based optimization ... adaptive estimates of lower-order moments. The method is straightforward to implement, is computationally efficient ... invariant to diagonal rescaling of the gradients, and is well suited for problems that ... terms of data and/or parameters. The method is also appropriate for non-stationary objectives...
  • SPG

  • Referenced in 70 articles [sw00897]
  • implementing the SPG method is introduced. SPG is a nonmonotone projected gradient algorithm for solving ... problems. It combines the classical projected gradient method with the spectral gradient choice of steplength...
  • Pegasos

  • Referenced in 85 articles [sw08752]
  • contrast, previous analyses of stochastic gradient descent methods for SVMs require Ω(1/ϵ2) iterations...
  • GENSMAC

  • Referenced in 60 articles [sw07093]
  • equations are solved by a finite difference method; the fluid surface is represented ... surface are accurately imposed; the conjugate gradient method is employed for solving the discrete Poisson...
  • TIGRA

  • Referenced in 38 articles [sw02333]
  • combination of Tikhonov regularization and the gradient method for solving nonlinear ill-posed problems ... presented. The TIGRA (Tikhonov-gradient method) algorithm proposed uses steepest descent iterations in an inner...
  • YSMP

  • Referenced in 72 articles [sw17947]
  • sparse. The current release features direct methods based on Gaussian elimination without pivoting ... include a number of preconditioned conjugate-gradient-like methods as described in Section...
  • NeNMF

  • Referenced in 29 articles [sw17586]
  • NeNMF: An optimal gradient method for non-negative matrix factorization. Nonnegative matrix factorization ... multiplicative update rule (MUR), the projected gradient method (PG), the projected nonnegative least squares (PNLS ... active set method (AS). However, they suffer from one or some of the following three ... problems. It applies Nesterov’s optimal gradient method to alternatively optimize one factor with another...
  • NESUN

  • Referenced in 30 articles [sw28733]
  • NESUN - Nesterov’s universal gradient method: Universal gradient methods for convex optimization problems. In this...
  • iPiano

  • Referenced in 43 articles [sw09623]
  • nonsmooth split version of the Heavy-ball method from Polyak. A rigorous analysis ... prove convergence for several other gradient methods. First, an abstract convergence theorem for a generic...
  • AdaGrad

  • Referenced in 87 articles [sw22202]
  • ADAGRAD: adaptive gradient algorithm; Adaptive subgradient methods for online learning and stochastic optimization. We present ... family of subgradient methods that dynamically incorporate knowledge of the geometry of the data observed ... earlier iterations to perform more informative gradient-based learning. Metaphorically, the adaptation allows ... which employ proximal functions to control the gradient steps of the algorithm. We describe...
  • PDNET

  • Referenced in 39 articles [sw04752]
  • primal-infeasible dual-feasible network interior point method The authors introduce the truncated primal-infeasible ... implementation, a preconditioned conjugate gradient method is used as the iterative solver. The details...