Inference in High Dimensions: Light-speed Algorithms and Information Limits
Project Period: 2024-10-01 – 2029-09-30
Funder:
European Research Council
Acronym
INF_2
Principal Investigator
Department(s)
Grant Number
101161364
Grant DOI
Funder
European Research Council
Funder Schema
HE-ERC-StG
Funder Registry
2 Publications
2025 | Published | Conference Paper | IST-REx-ID: 20033 | 
High-dimensional analysis of knowledge distillation: Weak-to-Strong generalization and scaling laws
M. Emrullah Ildiz, H.A. Gozeten, E.O. Taga, M. Mondelli, S. Oymak, in:, 13th International Conference on Learning Representations, ICLR, 2025, pp. 2967–3006.
[Published Version]
View
| Files available
| arXiv
M. Emrullah Ildiz, H.A. Gozeten, E.O. Taga, M. Mondelli, S. Oymak, in:, 13th International Conference on Learning Representations, ICLR, 2025, pp. 2967–3006.
2025 | Published | Conference Paper | IST-REx-ID: 20035 |
Wide neural networks trained with weight decay provably exhibit neural collapse
A. Jacot, P. Súkeník, Z. Wang, M. Mondelli, in:, 13th International Conference on Learning Representations, ICLR, 2025, pp. 1905–1931.
[Published Version]
View
| Files available
| arXiv
A. Jacot, P. Súkeník, Z. Wang, M. Mondelli, in:, 13th International Conference on Learning Representations, ICLR, 2025, pp. 1905–1931.