iPiano

iPiano: inertial proximal algorithm for nonconvex optimization. In this paper we study an algorithm for solving a minimization problem composed of a differentiable (possibly nonconvex) and a convex (possibly nondifferentiable) function. The algorithm iPiano combines forward-backward splitting with an inertial force. It can be seen as a nonsmooth split version of the Heavy-ball method from Polyak. A rigorous analysis of the algorithm for the proposed class of problems yields global convergence of the function values and the arguments. This makes the algorithm robust for usage on nonconvex problems. The convergence result is obtained based on the Kurdyka-Łojasiewicz inequality. This is a very weak restriction, which was used to prove convergence for several other gradient methods. First, an abstract convergence theorem for a generic algorithm is proved, and then iPiano is shown to satisfy the requirements of this theorem. Furthermore, a convergence rate is established for the general problem class. We demonstrate iPiano on computer vision problems – image denoising with learned priors and diffusion based image compression


References in zbMATH (referenced in 53 articles , 1 standard article )

Showing results 1 to 20 of 53.
Sorted by year (citations)

1 2 3 next

  1. Ahookhosh, Masoud; Hien, Le Thi Khanh; Gillis, Nicolas; Patrinos, Panagiotis: A block inertial Bregman proximal algorithm for nonsmooth nonconvex problems with application to symmetric nonnegative matrix tri-factorization (2021)
  2. Attouch, Hedy: Fast inertial proximal ADMM algorithms for convex structured optimization with linear constraint (2021)
  3. Breuß, Michael; Hoeltgen, Laurent; Radow, Georg: Towards PDE-based video compression with optimal masks prolongated by optic flow (2021)
  4. Hu, Yaohua; Li, Chong; Meng, Kaiwen; Yang, Xiaoqi: Linear convergence of inexact descent method and inexact proximal gradient algorithms for lower-order regularization problems (2021)
  5. Wu, Zhongming; Li, Chongshou; Li, Min; Lim, Andrew: Inertial proximal gradient methods with Bregman regularization for a class of nonconvex optimization problems (2021)
  6. Benning, Martin; Riis, Erlend Skaldehaug; Schönlieb, Carola-Bibiane: Bregman Itoh-Abe methods for sparse optimisation (2020)
  7. Gao, Xue; Cai, Xingju; Han, Deren: A Gauss-Seidel type inertial proximal alternating linearized minimization for a class of nonconvex optimization problems (2020)
  8. Gao, Yiming; Wu, Chunlin: On a general smoothly truncated regularization for variational piecewise constant image restoration: construction and convergent algorithms (2020)
  9. Kang, Myeongmin: Approximate versions of proximal iteratively reweighted algorithms including an extended IP-ICMM for signal and image processing problems (2020)
  10. Liu, Wenchen; Tang, Yincai; Wu, Xianyi: Separating variables to accelerate non-convex regularized optimization (2020)
  11. Loizou, Nicolas; Richtárik, Peter: Momentum and stochastic momentum for stochastic gradient, Newton, proximal point and subspace descent methods (2020)
  12. Banert, Sebastian; Bot, Radu Ioan: A general double-proximal gradient algorithm for d.c. programming (2019)
  13. Clason, Christian; Mazurenko, Stanislav; Valkonen, Tuomo: Acceleration and global convergence of a first-order primal-dual method for nonconvex problems (2019)
  14. de Oliveira, Welington; Tcheou, Michel P.: An inertial algorithm for DC programming (2019)
  15. Li, Y.; Sixou, B.; Peyrin, F.: Nonconvex mixed TV/Cahn-Hilliard functional for super-resolution/segmentation of 3D trabecular bone images (2019)
  16. Lu, Jian; Yang, Hanmei; Shen, Lixin; Zou, Yuru: Ultrasound image restoration based on a learned dictionary and a higher-order MRF (2019)
  17. Ochs, Peter: Unifying abstract inexact convergence theorems and block coordinate variable metric iPiano (2019)
  18. Tan, Pauline; Pierre, Fabien; Nikolova, Mila: Inertial alternating generalized forward-backward splitting for image colorization (2019)
  19. Tovey, Robert; Benning, Martin; Brune, Christoph; Lagerwerf, Marinus J.; Collins, Sean M.; Leary, Rowan K.; Midgley, Paul A.; Schönlieb, Carola-Bibiane: Directional sinogram inpainting for limited angle tomography (2019)
  20. Valkonen, Tuomo: Block-proximal methods with spatially adapted acceleration (2019)

1 2 3 next