Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise

Barbier J, Camilli F, Xu Y, Mondelli M. 2025. Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise. Physical Review Research. 7, 013081.

Download
OA 2025_PhysReviewResearch_Barbier.pdf 702.54 KB [Published Version]

Journal Article | Published | English

Scopus indexed
Author
Barbier, Jean; Camilli, Francesco; Xu, Yizhou; Mondelli, MarcoISTA
Department
Abstract
We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a Gaussian Wigner matrix, the more realistic case of structured noise still remains challenging. To capture the structure while maintaining mathematical tractability, a line of work has focused on rotationally invariant noise. However, existing studies either provide suboptimal algorithms or are limited to a special class of noise ensembles. In this paper, using tools from statistical physics (replica method) and random matrix theory (generalized spherical integrals) we establish the characterization of the information-theoretic limits for a noise matrix drawn from a general trace ensemble. Remarkably, our analysis unveils the asymptotic equivalence between the rotationally invariant model and a surrogate Gaussian one. Finally, we show how to saturate the predicted statistical limits using an efficient algorithm inspired by the theory of adaptive Thouless-Anderson-Palmer (TAP) equations.
Publishing Year
Date Published
2025-01-22
Journal Title
Physical Review Research
Publisher
American Physical Society
Acknowledgement
J.B., F.C., and Y.X. were funded by the European Union (ERC, CHORAL, Project No. 101039794). Views and opinions expressed are however those of the authors only and do not necessarily reflect those of the European Union or the European Research Council. Neither the European Union nor the granting authority can be held responsible for them. M.M. was supported by the 2019 Lopez-Loreta Prize. J.B. acknowledges discussions with TianQi Hou at the initial stage of the project, as well as with Antoine Bodin.
Volume
7
Article Number
013081
ISSN
IST-REx-ID

Cite this

Barbier J, Camilli F, Xu Y, Mondelli M. Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise. Physical Review Research. 2025;7. doi:10.1103/PhysRevResearch.7.013081
Barbier, J., Camilli, F., Xu, Y., & Mondelli, M. (2025). Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise. Physical Review Research. American Physical Society. https://doi.org/10.1103/PhysRevResearch.7.013081
Barbier, Jean, Francesco Camilli, Yizhou Xu, and Marco Mondelli. “Information Limits and Thouless-Anderson-Palmer Equations for Spiked Matrix Models with Structured Noise.” Physical Review Research. American Physical Society, 2025. https://doi.org/10.1103/PhysRevResearch.7.013081.
J. Barbier, F. Camilli, Y. Xu, and M. Mondelli, “Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise,” Physical Review Research, vol. 7. American Physical Society, 2025.
Barbier J, Camilli F, Xu Y, Mondelli M. 2025. Information limits and Thouless-Anderson-Palmer equations for spiked matrix models with structured noise. Physical Review Research. 7, 013081.
Barbier, Jean, et al. “Information Limits and Thouless-Anderson-Palmer Equations for Spiked Matrix Models with Structured Noise.” Physical Review Research, vol. 7, 013081, American Physical Society, 2025, doi:10.1103/PhysRevResearch.7.013081.
All files available under the following license(s):
Creative Commons Attribution 4.0 International Public License (CC-BY 4.0):
Main File(s)
Access Level
OA Open Access
Date Uploaded
2025-02-03
MD5 Checksum
52c5f72d80ffc928542469114fcdb62b


Export

Marked Publications

Open Data ISTA Research Explorer

Sources

arXiv 2405.20993

Search this title in

Google Scholar