glasso
The graphical lasso: new insights and alternatives. The graphical lasso [5] is an algorithm for learning the structure in an undirected Gaussian graphical model, using ℓ 1 regularization to control the number of zeros in the precision matrix Θ=Σ -1 [2, 11]. The R package glasso [5] is popular, fast, and allows one to efficiently build a path of models for different values of the tuning parameter. Convergence of glasso can be tricky; the converged precision matrix might not be the inverse of the estimated covariance, and occasionally it fails to converge with warm starts. In this paper we explain this behavior, and propose new algorithms that appear to outperform glasso. By studying the “normal equations” we see that, glasso is solving the dual of the graphical lasso penalized likelihood, by block coordinate ascent; a result which can also be found in [2]. In this dual, the target of estimation is Σ, the covariance matrix, rather than the precision matrix Θ. We propose similar primal algorithms p-glasso and dp-glasso, that also operate by block-coordinate descent, where Θ is the optimization target. We study all of these algorithms, and in particular different approaches to solving their coordinate sub-problems. We conclude that dp-glasso is superior from several points of view.
Keywords for this software
References in zbMATH (referenced in 236 articles , 1 standard article )
Showing results 1 to 20 of 236.
Sorted by year (- Bollhöfer, Matthias; Eftekhari, Aryan; Scheidegger, Simon; Schenk, Olaf: Large-scale sparse inverse covariance matrix estimation (2019)
- Pun, Chi Seng; Wong, Hoi Ying: A linear programming model for selection of sparse high-dimensional multiperiod portfolios (2019)
- Yue, Mu; Li, Jialiang; Cheng, Ming-Yen: Two-step sparse boosting for high-dimensional longitudinal data with varying coefficients (2019)
- Avanesov, Valeriy; Buzun, Nazar: Change-point detection in high-dimensional covariance structure (2018)
- Ayyıldız, Ezgi; Purutçuoğlu, Vilda; Weber, Gerhard Wilhelm: Loop-based conic multivariate adaptive regression splines is a novel method for advanced construction of complex biological networks (2018)
- Azose, Jonathan J.; Raftery, Adrian E.: Estimating large correlation matrices for international migration (2018)
- Barber, Rina Foygel; Kolar, Mladen: ROCKET: robust confidence intervals via Kendall’s tau for transelliptical graphical models (2018)
- Bilgrau, Anders Ellern; Brøndum, Rasmus Froberg; Eriksen, Poul Svante; Dybkær, Karen; Bøgsted, Martin: Estimating a common covariance matrix for network meta-analysis of gene expression datasets in diffuse large B-cell lymphoma (2018)
- Castelletti, Federico; Consonni, Guido; Della Vedova, Marco L.; Peluso, Stefano: Learning Markov equivalence classes of directed acyclic graphs: an objective Bayes approach (2018)
- Champion, Magali; Picheny, Victor; Vignes, Matthieu: Inferring large graphs using $\ell_1$-penalized likelihood (2018)
- Chang, Jinyuan; Qiu, Yumou; Yao, Qiwei; Zou, Tao: Confidence regions for entries of a large precision matrix (2018)
- Chen, Shuo; Kang, Jian; Xing, Yishi; Zhao, Yunpeng; Milton, Donald K.: Estimating large covariance matrix with network topology for high-dimensional biomedical data (2018)
- Devijver, Emilie; Gallopin, Mélina: Block-diagonal covariance selection for high-dimensional Gaussian graphical models (2018)
- Fan, Jianqing; Liu, Han; Wang, Weichen: Large covariance estimation through elliptical factor models (2018)
- Fan, Jianqing; Liu, Han; Wang, Weichen; Zhu, Ziwei: Heterogeneity adjustment with applications to graphical model inference (2018)
- Hao, Botao; Sun, Will Wei; Liu, Yufeng; Cheng, Guang: Simultaneous clustering and estimation of heterogeneous graphical models (2018)
- Hong, Younghee; Kim, Choongrak: Recent developments in high dimensional covariance estimation and its related issues, a review (2018)
- Janková, Jana; van de Geer, Sara: Semiparametric efficiency bounds for high-dimensional models (2018)
- Kakourou, Alexia; Mertens, Bart: Bayesian variable selection logistic regression with paired proteomic measurements (2018)
- Karl Sjöstrand; Line Clemmensen; Rasmus Larsen; Gudmundur Einarsson; Bjarne Ersbøll: SpaSM: A MATLAB Toolbox for Sparse Statistical Modeling (2018) not zbMATH