Please note that ISTA Research Explorer no longer supports Internet Explorer versions 8 or 9 (or earlier).
We recommend upgrading to the latest Internet Explorer, Google Chrome, or Firefox.
72 Publications
2024 | Published | Conference Paper | IST-REx-ID: 18973 |

Towards understanding the word sensitivity of attention layers: A study via random features
S. Bombari, M. Mondelli, in:, 41st International Conference on Machine Learning, ML Research Press, 2024, pp. 4300–4328.
[Preprint]
View
| Download Preprint (ext.)
| arXiv
S. Bombari, M. Mondelli, in:, 41st International Conference on Machine Learning, ML Research Press, 2024, pp. 4300–4328.
2024 | Published | Conference Paper | IST-REx-ID: 18972 |

How spurious features are memorized: Precise analysis for random and NTK features
S. Bombari, M. Mondelli, in:, 41st International Conference on Machine Learning, ML Research Press, 2024, pp. 4267–4299.
[Preprint]
View
| Download Preprint (ext.)
| arXiv
S. Bombari, M. Mondelli, in:, 41st International Conference on Machine Learning, ML Research Press, 2024, pp. 4267–4299.
2024 | Published | Journal Article | IST-REx-ID: 15172 |

Concentration without independence via information measures
A.R. Esposito, M. Mondelli, IEEE Transactions on Information Theory 70 (2024) 3823–3839.
[Preprint]
View
| Files available
| DOI
| Download Preprint (ext.)
| arXiv
A.R. Esposito, M. Mondelli, IEEE Transactions on Information Theory 70 (2024) 3823–3839.
2024 | Published | Conference Paper | IST-REx-ID: 17147
Inference of genetic effects via approximate message passing
A. Depope, M. Mondelli, M.R. Robinson, in:, 2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, IEEE, 2024, pp. 13151–13155.
View
| DOI
A. Depope, M. Mondelli, M.R. Robinson, in:, 2024 IEEE International Conference on Acoustics, Speech, and Signal Processing, IEEE, 2024, pp. 13151–13155.
2024 | Published | Conference Paper | IST-REx-ID: 18897 |

Improved convergence of score-based diffusion models via prediction-correction
F. Pedrotti, J. Maas, M. Mondelli, in:, Transactions on Machine Learning Research, 2024.
[Published Version]
View
| Files available
| arXiv
F. Pedrotti, J. Maas, M. Mondelli, in:, Transactions on Machine Learning Research, 2024.
2024 | Draft | Preprint | IST-REx-ID: 17350 |

Improved convergence of score-based diffusion models via prediction-correction
F. Pedrotti, J. Maas, M. Mondelli, ArXiv (n.d.).
[Preprint]
View
| Files available
| DOI
| Download Preprint (ext.)
| arXiv
F. Pedrotti, J. Maas, M. Mondelli, ArXiv (n.d.).
2024 | Published | Conference Paper | IST-REx-ID: 18890 |

Average gradient outer product as a mechanism for deep neural collapse
D. Beaglehole, P. Súkeník, M. Mondelli, M. Belkin, in:, 38th Annual Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Preprint]
View
| Download Preprint (ext.)
| arXiv
D. Beaglehole, P. Súkeník, M. Mondelli, M. Belkin, in:, 38th Annual Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
2024 | Published | Conference Paper | IST-REx-ID: 19518 |

The iterative optimal brain surgeon: Faster sparse recovery by leveraging second-order information
D. Wu, I.-V. Modoranu, M. Safaryan, D. Kuznedelev, D.-A. Alistarh, in:, 38th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Preprint]
View
| Download Preprint (ext.)
| arXiv
D. Wu, I.-V. Modoranu, M. Safaryan, D. Kuznedelev, D.-A. Alistarh, in:, 38th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
2024 | Published | Conference Paper | IST-REx-ID: 18891 |

Neural collapse versus low-rank bias: Is deep neural collapse really optimal?
P. Súkeník, C. Lampert, M. Mondelli, in:, 38th Annual Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Published Version]
View
| Files available
P. Súkeník, C. Lampert, M. Mondelli, in:, 38th Annual Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
2024 | Published | Thesis | IST-REx-ID: 17465 |

High-dimensional limits in artificial neural networks
A. Shevchenko, High-Dimensional Limits in Artificial Neural Networks, Institute of Science and Technology Austria, 2024.
[Published Version]
View
| Files available
| DOI
A. Shevchenko, High-Dimensional Limits in Artificial Neural Networks, Institute of Science and Technology Austria, 2024.
2024 | Published | Conference Paper | IST-REx-ID: 17469 |

Compression of structured data with autoencoders: Provable benefit of nonlinearities and depth
K. Kögler, A. Shevchenko, H. Hassani, M. Mondelli, in:, Proceedings of the 41st International Conference on Machine Learning, ML Research Press, 2024, pp. 24964–25015.
[Published Version]
View
| Files available
| Download Published Version (ext.)
| arXiv
K. Kögler, A. Shevchenko, H. Hassani, M. Mondelli, in:, Proceedings of the 41st International Conference on Machine Learning, ML Research Press, 2024, pp. 24964–25015.
2023 | Published | Journal Article | IST-REx-ID: 13269 |

Codes for the Z-channel
N. Polyanskii, Y. Zhang, IEEE Transactions on Information Theory 69 (2023) 6340–6357.
[Preprint]
View
| DOI
| Download Preprint (ext.)
| WoS
| arXiv
N. Polyanskii, Y. Zhang, IEEE Transactions on Information Theory 69 (2023) 6340–6357.
2023 | Published | Journal Article | IST-REx-ID: 12838 |

Multiple packing: Lower bounds via infinite constellations
Y. Zhang, S. Vatedka, IEEE Transactions on Information Theory 69 (2023) 4513–4527.
[Preprint]
View
| DOI
| Download Preprint (ext.)
| WoS
| arXiv
Y. Zhang, S. Vatedka, IEEE Transactions on Information Theory 69 (2023) 4513–4527.
2023 | Published | Journal Article | IST-REx-ID: 14751 |

Zero-error communication over adversarial MACs
Y. Zhang, IEEE Transactions on Information Theory 69 (2023) 4093–4127.
[Preprint]
View
| DOI
| Download Preprint (ext.)
| arXiv
Y. Zhang, IEEE Transactions on Information Theory 69 (2023) 4093–4127.
2023 | Published | Conference Paper | IST-REx-ID: 14083 |

Zero-rate thresholds and new capacity bounds for list-decoding and list-recovery
Resch, Nicolas, Zero-rate thresholds and new capacity bounds for list-decoding and list-recovery. 50th International Colloquium on Automata, Languages, and Programming 261. 2023
[Published Version]
View
| Files available
| DOI
| arXiv
Resch, Nicolas, Zero-rate thresholds and new capacity bounds for list-decoding and list-recovery. 50th International Colloquium on Automata, Languages, and Programming 261. 2023
2023 | Published | Conference Paper | IST-REx-ID: 14923 |

Mismatched estimation of non-symmetric rank-one matrices corrupted by structured noise
Fu, Teng, Mismatched estimation of non-symmetric rank-one matrices corrupted by structured noise. Proceedings of 2023 IEEE International Symposium on Information Theory. 2023
[Preprint]
View
| DOI
| Download Preprint (ext.)
| arXiv
Fu, Teng, Mismatched estimation of non-symmetric rank-one matrices corrupted by structured noise. Proceedings of 2023 IEEE International Symposium on Information Theory. 2023
2023 | Published | Conference Paper | IST-REx-ID: 14922 |

Concentration without independence via information measures
Esposito, Amedeo Roberto, Concentration without independence via information measures. Proceedings of 2023 IEEE International Symposium on Information Theory. 2023
[Preprint]
View
| Files available
| DOI
| Download Preprint (ext.)
| arXiv
Esposito, Amedeo Roberto, Concentration without independence via information measures. Proceedings of 2023 IEEE International Symposium on Information Theory. 2023
2023 | Published | Journal Article | IST-REx-ID: 13315 |

Fundamental limits in structured principal component analysis and how to reach them
J. Barbier, F. Camilli, M. Mondelli, M. Sáenz, Proceedings of the National Academy of Sciences of the United States of America 120 (2023).
[Published Version]
View
| Files available
| DOI
| PubMed | Europe PMC
J. Barbier, F. Camilli, M. Mondelli, M. Sáenz, Proceedings of the National Academy of Sciences of the United States of America 120 (2023).
2023 | Published | Conference Paper | IST-REx-ID: 13321 |

Approximate message passing for multi-layer estimation in rotationally invariant models
Y. Xu, T.Q. Hou, S.S. Liang, M. Mondelli, in:, 2023 IEEE Information Theory Workshop, Institute of Electrical and Electronics Engineers, 2023, pp. 294–298.
[Preprint]
View
| DOI
| Download Preprint (ext.)
| WoS
| arXiv
Y. Xu, T.Q. Hou, S.S. Liang, M. Mondelli, in:, 2023 IEEE Information Theory Workshop, Institute of Electrical and Electronics Engineers, 2023, pp. 294–298.
2023 | Published | Conference Paper | IST-REx-ID: 12859 |

Beyond the universal law of robustness: Sharper laws for random features and neural tangent kernels
S. Bombari, S. Kiyani, M. Mondelli, in:, Proceedings of the 40th International Conference on Machine Learning, ML Research Press, 2023, pp. 2738–2776.
[Preprint]
View
| Files available
| Download Preprint (ext.)
| arXiv
S. Bombari, S. Kiyani, M. Mondelli, in:, Proceedings of the 40th International Conference on Machine Learning, ML Research Press, 2023, pp. 2738–2776.