OptShrink

OptShrink: an algorithm for improved low-rank signal matrix denoising by optimal, data-driven singular value shrinkage. OptShrink is a simple, completely data-driven algorithm for denoising a low-rank signal matrix buried in noise. It takes as its input the signal-plus-noise matrix, an estimate of the signal matrix rank and returns as an output the improved signal matrix estimate. It computes this estimate by shrinking the singular values corresponding to the Truncated SVD (TSVD) in the correct manner as given by random matrix theory. It can be used in the missing data setting and for a large class of noise models for which the i.i.d. Gaussian setting is a special case. There are no tuning parameters involved so it can be used in a black-box manner wherever improving low-rank matrix estimation is desirable. The algorithm outperforms the truncated SVD (TSVD) significantly in the low to moderate SNR regime and will never do worse than the TSVD. The theory also explains why it will always do better than singular value thresholding.


References in zbMATH (referenced in 15 articles , 1 standard article )

Showing results 1 to 15 of 15.
Sorted by year (citations)

  1. Cordero-Grande, Lucilio: MIXANDMIX: numerical techniques for the computation of empirical spectral distributions of population mixtures (2020)
  2. Ding, Xiucai: High dimensional deformed rectangular matrices with applications in matrix denoising (2020)
  3. Dobriban, Edgar: Permutation methods for factor analysis and PCA (2020)
  4. Dobriban, Edgar; Leeb, William; Singer, Amit: Optimal prediction in the linearly transformed spiked model (2020)
  5. Johnstone, Iain M.; Onatski, Alexei: Testing in high-dimensional spiked models (2020)
  6. Lazzaro, Damiana; Morigi, Serena: Matrix completion for matrices with low-rank displacement (2020)
  7. Lettau, Martin; Pelger, Markus: Estimating latent asset-pricing factors (2020)
  8. Prasadan, Arvind; Nadakuditi, Raj Rao: Time series source separation using dynamic mode decomposition (2020)
  9. Dobriban, Edgar; Owen, Art B.: Deterministic parallel analysis: an improved method for selecting factors and principal components (2019)
  10. Hong, David; Balzano, Laura; Fessler, Jeffrey A.: Asymptotic performance of PCA for high-dimensional heteroscedastic data (2018)
  11. Liu, Lydia T.; Dobriban, Edgar; Singer, Amit: (e)PCA: high dimensional exponential family PCA (2018)
  12. Bigot, Jérémie; Deledalle, Charles; Féral, Delphine: Generalized SURE for optimal shrinkage of singular values in low-rank matrix denoising (2017)
  13. Chatterjee, Sourav: Matrix estimation by universal singular value thresholding (2015)
  14. Dobriban, Edgar: Efficient computation of limit spectra of sample covariance matrices (2014)
  15. Nadakuditi, Raj Rao: OptShrink: an algorithm for improved low-rank signal matrix denoising by optimal, data-driven singular value shrinkage (2014)