glasso
The graphical lasso: new insights and alternatives The graphical lasso [5] is an algorithm for learning the structure in an undirected Gaussian graphical model, using ℓ 1 regularization to control the number of zeros in the precision matrix Θ=Σ -1 [2, 11]. The R package glasso [5] is popular, fast, and allows one to efficiently build a path of models for different values of the tuning parameter. Convergence of glasso can be tricky; the converged precision matrix might not be the inverse of the estimated covariance, and occasionally it fails to converge with warm starts. In this paper we explain this behavior, and propose new algorithms that appear to outperform glasso. By studying the “normal equations” we see that, glasso is solving the dual of the graphical lasso penalized likelihood, by block coordinate ascent; a result which can also be found in [2]. In this dual, the target of estimation is Σ, the covariance matrix, rather than the precision matrix Θ. We propose similar primal algorithms p-glasso and dp-glasso, that also operate by block-coordinate descent, where Θ is the optimization target. We study all of these algorithms, and in particular different approaches to solving their coordinate sub-problems. We conclude that dp-glasso is superior from several points of view.
Keywords for this software
References in zbMATH (referenced in 115 articles , 1 standard article )
Showing results 1 to 20 of 115.
Sorted by year (- Kühnel, Line; Sommer, Stefan; Pai, Akshay; Raket, Lars Lau: Most likely separation of intensity and warping effects in image registration (2017)
- Zhang, Hai; Wang, Puyu; Dong, Qing; Wang, Pu: Sparse Bayesian linear regression using generalized normal priors (2017)
- Adragni, Kofi P.; Al-Najjar, Elias; Martin, Sean; Popuri, Sai K.; Raim, Andrew M.: Group-wise sufficient dimension reduction with principal fitted components (2016)
- Bai, Jushan; Liao, Yuan: Efficient estimation of approximate factor models via penalized maximum likelihood (2016)
- Bar-Hen, Avner; Poggi, Jean-Michel: Influence measures and stability for graphical models (2016)
- Blum, Yuna; Houée-Bigot, Magalie; Causeur, David: Sparse factor model for co-expression networks with an application using prior biological knowledge (2016)
- Chen, Lisha; Huang, Jianhua Z.: Sparse reduced-rank regression with covariance estimation (2016)
- Chun, Hyonho; Lee, Myung Hee; Fleet, James C.; Oh, Ji Hwan: Graphical models via joint quantile regression with component selection (2016)
- Fourdrinier, Dominique; Mezoued, Fatiha; Wells, Martin T.: Estimation of the inverse scatter matrix of an elliptically symmetric distribution (2016)
- Goncalves, André R.; von Zuben, Fernando J.; Banerjee, Arindam: Multi-task sparse structure learning with Gaussian copula models (2016)
- Lin, Jiahe; Basu, Sumanta; Banerjee, Moulinath; Michailidis, George: Penalized maximum likelihood estimation of multi-layered Gaussian graphical models (2016)
- Martin, Victorin; Lasgouttes, Jean-Marc; Furtlehner, Cyril: Latent binary MRF for online reconstruction of large scale systems (2016)
- Maurya, Ashwini: A well-conditioned and sparse estimation of covariance and inverse covariance matrices using a joint penalty (2016)
- Müller, Patric; van de Geer, Sara: Censored linear model in high dimensions. Penalised linear regression on high-dimensional data with left-censored response variable (2016)
- Oates, Chris J.; Smith, Jim Q.; Mukherjee, Sach; Cussens, James: Exact estimation of multiple directed acyclic graphs (2016)
- Scheinberg, Katya; Tang, Xiaocheng: Practical inexact proximal quasi-Newton method with global complexity analysis (2016)
- Soloveychik, I.; Trushin, D.: Gaussian and robust Kronecker product covariance estimation: existence and uniqueness (2016)
- Treister, Eran; Turek, Javier S.; Yavneh, Irad: A multilevel framework for sparse optimization with application to inverse covariance estimation and logistic regression (2016)
- Vinciotti, Veronica; Augugliaro, Luigi; Abbruzzo, Antonino; Wit, Ernst C.: Model selection for factorial Gaussian graphical models with an application to dynamic regulatory networks (2016)
- Zhang, Lin; Sarkar, Abhra; Mallick, Bani K.: Bayesian sparse covariance decomposition with a graphical structure (2016)