The price of ignorance: How much does it cost to forget noise structure in low-rank matrix estimation?
Barbier J, Hou T, Mondelli M, Saenz M. 2022. The price of ignorance: How much does it cost to forget noise structure in low-rank matrix estimation? 36th Annual Conference on Neural Information Processing Systems. NeurIPS: Neural Information Processing Systems, NeurIPS, vol. 35.
Download (ext.)
https://arxiv.org/abs/2205.10009
[Preprint]
Conference Paper
| Published
| English
Scopus indexed
Author
Barbier, Jean;
Hou, TianQi;
Mondelli, MarcoISTA ;
Saenz, Manuel
Corresponding author has ISTA affiliation
Department
Series Title
NeurIPS
Abstract
We consider the problem of estimating a rank-1 signal corrupted by structured rotationally invariant noise, and address the following question: how well do inference algorithms perform when the noise statistics is unknown and hence Gaussian noise is assumed? While the matched Bayes-optimal setting with unstructured noise is well understood, the analysis of this mismatched problem is only at its premises. In this paper, we make a step towards understanding the effect of the strong source of mismatch which is the noise statistics. Our main technical contribution is the rigorous analysis of a Bayes estimator and of an approximate message passing (AMP) algorithm, both of which incorrectly assume a Gaussian setup. The first result exploits the theory of spherical integrals and of low-rank matrix perturbations; the idea behind the second one is to design and analyze an artificial AMP which, by taking advantage of the flexibility in the denoisers, is able to "correct" the mismatch. Armed with these sharp asymptotic characterizations, we unveil a rich and often unexpected phenomenology. For example, despite AMP is in principle designed to efficiently compute the Bayes estimator, the former is outperformed by the latter in terms of mean-square error. We show that this performance gap is due to an incorrect estimation of the signal norm. In fact, when the SNR is large enough, the overlaps of the AMP and the Bayes estimator coincide, and they even match those of optimal estimators taking into account the structure of the noise.
Publishing Year
Date Published
2022-11-20
Proceedings Title
36th Annual Conference on Neural Information Processing Systems
Acknowledgement
M. Mondelli was partially supported by the 2019 Lopez-Loreta Prize. The authors acknowledge
discussions with A. Krajenbrink, M. Robinson, A. Depope, N. Macris and F. Pourkamali.
Volume
35
Conference
NeurIPS: Neural Information Processing Systems
Conference Location
New Orleans, LA, United States
Conference Date
2022-11-28 – 2022-12-09
ISBN
IST-REx-ID
Cite this
Barbier J, Hou T, Mondelli M, Saenz M. The price of ignorance: How much does it cost to forget noise structure in low-rank matrix estimation? In: 36th Annual Conference on Neural Information Processing Systems. Vol 35. ; 2022.
Barbier, J., Hou, T., Mondelli, M., & Saenz, M. (2022). The price of ignorance: How much does it cost to forget noise structure in low-rank matrix estimation? In 36th Annual Conference on Neural Information Processing Systems (Vol. 35). New Orleans, LA, United States.
Barbier, Jean, TianQi Hou, Marco Mondelli, and Manuel Saenz. “The Price of Ignorance: How Much Does It Cost to Forget Noise Structure in Low-Rank Matrix Estimation?” In 36th Annual Conference on Neural Information Processing Systems, Vol. 35, 2022.
J. Barbier, T. Hou, M. Mondelli, and M. Saenz, “The price of ignorance: How much does it cost to forget noise structure in low-rank matrix estimation?,” in 36th Annual Conference on Neural Information Processing Systems, New Orleans, LA, United States, 2022, vol. 35.
Barbier J, Hou T, Mondelli M, Saenz M. 2022. The price of ignorance: How much does it cost to forget noise structure in low-rank matrix estimation? 36th Annual Conference on Neural Information Processing Systems. NeurIPS: Neural Information Processing Systems, NeurIPS, vol. 35.
Barbier, Jean, et al. “The Price of Ignorance: How Much Does It Cost to Forget Noise Structure in Low-Rank Matrix Estimation?” 36th Annual Conference on Neural Information Processing Systems, vol. 35, 2022.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Link(s) to Main File(s)
Access Level
Open Access
Export
Marked PublicationsOpen Data ISTA Research Explorer
Sources
arXiv 2205.10009