• CGS

  • Referenced in 305 articles [sw08225]
  • algorithm (a “squared” conjugate gradient method) with a preconditioning called ILLU (an incomplete line...
  • LSQR

  • Referenced in 377 articles [sw00530]
  • analytically equivalent to the standard method of conjugate gradients, but possesses more favorable numerical properties ... method, subroutine LSQR. Numerical tests are described comparing LSQR with several other conjugate-gradient algorithms...
  • lobpcg.m

  • Referenced in 130 articles [sw24008]
  • locally optimal block preconditioned conjugate gradient method: Toward the optimal preconditioned eigensolver: Locally optimal block ... preconditioned conjugate gradient method. We describe new algorithms of the locally optimal block preconditioned conjugate ... gradient (LOBPCG) method for symmetric eigenvalue problems, based on a local optimization of a three ... advocate the standard preconditioned conjugate gradient method for finding an eigenvector as an element...
  • tn

  • Referenced in 136 articles [sw05140]
  • linear conjugate-gradient method (developed via the Lanczos method) in the solution of large-scale ... Lanczos characterization of the linear conjugate-gradient method may be exploited to define a modified ... iterations earlier. A preconditioned truncated Newton method is described that defines a search direction which ... direction defined by a nonlinear conjugate-gradient-type method and a modified Newton direction. Numerical...
  • Adam

  • Referenced in 453 articles [sw22205]
  • Method for Stochastic Optimization. We introduce Adam, an algorithm for first-order gradient-based optimization ... adaptive estimates of lower-order moments. The method is straightforward to implement, is computationally efficient ... invariant to diagonal rescaling of the gradients, and is well suited for problems that ... terms of data and/or parameters. The method is also appropriate for non-stationary objectives...
  • KELLEY

  • Referenced in 617 articles [sw04829]
  • chapters conclude with a demonstration of the methods discussed in the respective chapter using ... cases the noise often introduces artificial minimizers. Gradient information, even if available, cannot expected ... group. Implicit filtering methods use finite difference approximations of the gradient, which are adjusted ... conclude with a numerical demonstration of the methods discussed in the respective chapter, and with...
  • TRON

  • Referenced in 111 articles [sw04714]
  • constrained optimization problems. TRON uses a gradient projection method to generate ... Cauchy step, a preconditioned conjugate gradient method with an incomplete Cholesky factorization to generate...
  • CG_DESCENT

  • Referenced in 125 articles [sw04813]
  • Algorithm 851: CG_DESCENT. A conjugate gradient method with guaranteed descent Recently, a new nonlinear ... conjugate gradient scheme was developed which satisfies the descent condition gTkdk ... extensive numerical tests and comparisons with other methods for large-scale unconstrained optimization are given...
  • BiCGstab

  • Referenced in 126 articles [sw04022]
  • BiCGstab(l) of the bi-conjugate gradient method for the solution of a system...
  • SPGL1

  • Referenced in 182 articles [sw08365]
  • domain. At each iteration, a spectral gradient-projection method approximately minimizes a least-squares problem...
  • Saga

  • Referenced in 85 articles [sw39677]
  • SAGA: A Fast Incremental Gradient Method With Support for Non-Strongly Convex Composite Objectives ... this work we introduce a new optimisation method called SAGA in the spirit ... SVRG, a set of recently proposed incremental gradient algorithms with fast linear convergence rates. SAGA ... experimental results showing the effectiveness of our method...
  • SPG

  • Referenced in 74 articles [sw00897]
  • implementing the SPG method is introduced. SPG is a nonmonotone projected gradient algorithm for solving ... problems. It combines the classical projected gradient method with the spectral gradient choice of steplength...
  • Pegasos

  • Referenced in 98 articles [sw08752]
  • contrast, previous analyses of stochastic gradient descent methods for SVMs require Ω(1/ϵ2) iterations...
  • GENSMAC

  • Referenced in 60 articles [sw07093]
  • equations are solved by a finite difference method; the fluid surface is represented ... surface are accurately imposed; the conjugate gradient method is employed for solving the discrete Poisson...
  • AdaGrad

  • Referenced in 124 articles [sw22202]
  • ADAGRAD: adaptive gradient algorithm; Adaptive subgradient methods for online learning and stochastic optimization. We present ... family of subgradient methods that dynamically incorporate knowledge of the geometry of the data observed ... earlier iterations to perform more informative gradient-based learning. Metaphorically, the adaptation allows ... which employ proximal functions to control the gradient steps of the algorithm. We describe...
  • NESUN

  • Referenced in 39 articles [sw28733]
  • NESUN - Nesterov’s universal gradient method: Universal gradient methods for convex optimization problems. In this...
  • TIGRA

  • Referenced in 40 articles [sw02333]
  • combination of Tikhonov regularization and the gradient method for solving nonlinear ill-posed problems ... presented. The TIGRA (Tikhonov-gradient method) algorithm proposed uses steepest descent iterations in an inner...
  • iPiano

  • Referenced in 51 articles [sw09623]
  • nonsmooth split version of the Heavy-ball method from Polyak. A rigorous analysis ... prove convergence for several other gradient methods. First, an abstract convergence theorem for a generic...
  • NeNMF

  • Referenced in 31 articles [sw17586]
  • NeNMF: An optimal gradient method for non-negative matrix factorization. Nonnegative matrix factorization ... multiplicative update rule (MUR), the projected gradient method (PG), the projected nonnegative least squares (PNLS ... active set method (AS). However, they suffer from one or some of the following three ... problems. It applies Nesterov’s optimal gradient method to alternatively optimize one factor with another...
  • PESTO

  • Referenced in 30 articles [sw20864]
  • fast proximal gradient, conditional gradient, subgradient and alternating projection methods. In particular, we present ... worst-case guarantee for the conditional gradient method by more than a factor ... also show how the optimized gradient method proposed by Kim and Fessler ... fast as the standard accelerated proximal gradient method...