Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise
Barbier J, Camilli F, Xu Y, Mondelli M. 2025. Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise. Physical Review Research. 7, 013081.
Download
Journal Article
| Published
| English
Scopus indexed
Author
Barbier, Jean;
Camilli, Francesco;
Xu, Yizhou;
Mondelli, MarcoISTA 

Department
Abstract
We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a Gaussian Wigner matrix, the more realistic case of structured noise still remains challenging. To capture the structure while maintaining mathematical tractability, a line of work has focused on rotationally invariant noise. However, existing studies either provide suboptimal algorithms or are limited to a special class of noise ensembles. In this paper, using tools from statistical physics (replica method) and random matrix theory (generalized spherical integrals) we establish the characterization of the information-theoretic limits for a noise matrix drawn from a general trace ensemble. Remarkably, our analysis unveils the asymptotic equivalence between the rotationally invariant model and a surrogate Gaussian one. Finally, we show how to saturate the predicted statistical limits using an efficient algorithm inspired by the theory of adaptive Thouless-Anderson-Palmer (TAP) equations.
Publishing Year
Date Published
2025-01-22
Journal Title
Physical Review Research
Publisher
American Physical Society
Acknowledgement
J.B., F.C., and Y.X. were funded by the European Union (ERC, CHORAL, Project No. 101039794). Views and opinions expressed are however those of the authors only and do not necessarily reflect those of the European Union or the European Research Council. Neither the European Union nor the granting authority can be held responsible for them. M.M. was supported by the 2019 Lopez-Loreta Prize. J.B. acknowledges discussions with TianQi Hou at the initial stage of the project, as well as with Antoine Bodin.
Volume
7
Article Number
013081
ISSN
IST-REx-ID
Cite this
Barbier J, Camilli F, Xu Y, Mondelli M. Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise. Physical Review Research. 2025;7. doi:10.1103/PhysRevResearch.7.013081
Barbier, J., Camilli, F., Xu, Y., & Mondelli, M. (2025). Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise. Physical Review Research. American Physical Society. https://doi.org/10.1103/PhysRevResearch.7.013081
Barbier, Jean, Francesco Camilli, Yizhou Xu, and Marco Mondelli. “Information Limits and Thouless-Anderson-Palmer Equations for Spiked Matrix Models with Structured Noise.” Physical Review Research. American Physical Society, 2025. https://doi.org/10.1103/PhysRevResearch.7.013081.
J. Barbier, F. Camilli, Y. Xu, and M. Mondelli, “Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise,” Physical Review Research, vol. 7. American Physical Society, 2025.
Barbier J, Camilli F, Xu Y, Mondelli M. 2025. Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise. Physical Review Research. 7, 013081.
Barbier, Jean, et al. “Information Limits and Thouless-Anderson-Palmer Equations for Spiked Matrix Models with Structured Noise.” Physical Review Research, vol. 7, 013081, American Physical Society, 2025, doi:10.1103/PhysRevResearch.7.013081.
All files available under the following license(s):
Creative Commons Attribution 4.0 International Public License (CC-BY 4.0):
Main File(s)
File Name
2025_PhysReviewResearch_Barbier.pdf
702.54 KB
Access Level

Date Uploaded
2025-02-03
MD5 Checksum
52c5f72d80ffc928542469114fcdb62b
Export
Marked PublicationsOpen Data ISTA Research Explorer
Sources
arXiv 2405.20993