Please note that ISTA Research Explorer no longer supports Internet Explorer versions 8 or 9 (or earlier).

We recommend upgrading to the latest Internet Explorer, Google Chrome, or Firefox.

22 Publications


2024 | Published | Conference Paper | IST-REx-ID: 19518 | OA
The iterative optimal brain surgeon: Faster sparse recovery by leveraging second-order information
D. Wu, I.-V. Modoranu, M. Safaryan, D. Kuznedelev, D.-A. Alistarh, in:, 38th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Preprint] View | Download Preprint (ext.) | arXiv
 

2024 | Published | Conference Paper | IST-REx-ID: 19512 | OA
Continual counting with gradual privacy expiration
J.D. Andersson, M. Henzinger, R. Pagh, T.A. Steiner, J. Upadhyay, in:, 38th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Preprint] View | Download Preprint (ext.) | arXiv
 

2024 | Published | Conference Paper | IST-REx-ID: 19515 | OA
Latent functional maps: A spectral framework for representation alignment
M. Fumero, M. Pegoraro, V. Maiorca, F. Locatello, E. Rodolà, in:, 38th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Preprint] View | Download Preprint (ext.) | arXiv
 

2024 | Published | Conference Paper | IST-REx-ID: 19510 | OA
MICROADAM: Accurate adaptive optimization with low space overhead and provable convergence
I.-V. Modoranu, M. Safaryan, G. Malinovsky, E. Kurtic, T. Robert, P. Richtárik, D.-A. Alistarh, in:, 38th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Preprint] View | Files available | Download Preprint (ext.) | arXiv
 

2024 | Published | Conference Paper | IST-REx-ID: 19517 | OA
C2M3: Cycle-consistent multi-model merging
D. Crisostomi, M. Fumero, D. Baieri, F. Bernard, E. Rodolà, in:, 38th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Preprint] View | Download Preprint (ext.) | arXiv
 

2024 | Published | Conference Paper | IST-REx-ID: 19511 | OA
QuaRot: Outlier-free 4-bit inference in rotated LLMs
S. Ashkboos, A. Mohtashami, M.L. Croci, B. Li, P. Cameron, M. Jaggi, D.-A. Alistarh, T. Hoefler, J. Hensman, in:, 38th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Preprint] View | Files available | Download Preprint (ext.) | arXiv
 

2024 | Published | Conference Paper | IST-REx-ID: 19519 | OA
PV-tuning: Beyond straight-through estimation for extreme LLM compression
V. Malinovskii, D. Mazur, I. Ilin, D. Kuznedelev, K. Burlachenko, K. Yi, D.-A. Alistarh, P. Richtarik, in:, 38th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2024.
[Published Version] View | Files available | arXiv
 

2023 | Published | Conference Paper | IST-REx-ID: 15363 | OA
Knowledge distillation performs partial variance reduction
M. Safaryan, A. Krumes, D.-A. Alistarh, in:, 36th Conference on Neural Information Processing Systems, 2023.
[Published Version] View | Files available | arXiv
 

2023 | Published | Conference Paper | IST-REx-ID: 15364 | OA
Simple, scalable and effective clustering via one-dimensional projections
M. Charikar, L. Hu, M. Henzinger, M. Vötsch, E. Waingarten, in:, 37th Conference on Neural Information Processing Systems, 2023.
[Published Version] View | Files available | arXiv
 

2022 | Published | Conference Paper | IST-REx-ID: 18876 | OA
The unreasonable effectiveness of fully-connected layers for low-data regimes
P. Kocsis, P. Súkeník, G. Brasó, M. Niessner, L. Leal-Taixé, I. Elezi, in:, 36th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2022, pp. 1896–1908.
[Published Version] View | Files available | arXiv
 

2021 | Published | Conference Paper | IST-REx-ID: 11453 | OA
Online learning of neural computations from sparse temporal feedback
L. Braun, T.P. Vogels, in:, Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2021, pp. 16437–16450.
[Published Version] View | Download Published Version (ext.)
 

2021 | Published | Conference Paper | IST-REx-ID: 11452 | OA
Distributed principal component analysis with limited communication
F. Alimisis, P. Davies, B. Vandereycken, D.-A. Alistarh, in:, Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2021, pp. 2823–2834.
[Published Version] View | Download Published Version (ext.) | arXiv
 

2021 | Published | Conference Paper | IST-REx-ID: 10593 | OA
PCA initialization for approximate message passing in rotationally invariant models
M. Mondelli, R. Venkataramanan, in:, 35th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2021, pp. 29616–29629.
[Preprint] View | Download Preprint (ext.) | arXiv
 

2021 | Published | Conference Paper | IST-REx-ID: 10594 | OA
When are solutions connected in deep networks?
Q. Nguyen, P. Bréchet, M. Mondelli, in:, 35th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2021.
[Preprint] View | Download Preprint (ext.) | arXiv
 

2021 | Published | Conference Paper | IST-REx-ID: 11458 | OA
AC/DC: Alternating Compressed/DeCompressed training of deep neural networks
A. Krumes, E.B. Iofinova, A. Vladu, D.-A. Alistarh, in:, 35th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2021, pp. 8557–8570.
[Published Version] View | Files available | Download Published Version (ext.) | arXiv
 

2021 | Published | Conference Paper | IST-REx-ID: 11463 | OA
M-FAC: Efficient matrix-free approximations of second-order information
E. Frantar, E. Kurtic, D.-A. Alistarh, in:, 35th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2021, pp. 14873–14886.
[Published Version] View | Download Published Version (ext.) | arXiv
 

2021 | Published | Conference Paper | IST-REx-ID: 11464 | OA
Towards tight communication lower bounds for distributed optimisation
D.-A. Alistarh, J. Korhonen, in:, 35th Conference on Neural Information Processing Systems, Neural Information Processing Systems Foundation, 2021, pp. 7254–7266.
[Published Version] View | Download Published Version (ext.) | arXiv
 

2020 | Published | Conference Paper | IST-REx-ID: 9632 | OA
WoodFisher: Efficient second-order approximation for neural network compression
S.P. Singh, D.-A. Alistarh, in:, Neural Information Processing Systems Foundation, 2020, pp. 18098–18109.
[Published Version] View | Download Published Version (ext.) | arXiv
 

2020 | Published | Conference Paper | IST-REx-ID: 9631 | OA
Scalable belief propagation via relaxed scheduling
V. Aksenov, D.-A. Alistarh, J. Korhonen, in:, Neural Information Processing Systems Foundation, 2020, pp. 22361–22372.
[Published Version] View | Download Published Version (ext.) | arXiv
 

2020 | Published | Conference Paper | IST-REx-ID: 9633 | OA
A meta-learning approach to (re)discover plasticity rules that carve a desired function into a neural network
B.J. Confavreux, F. Zenke, E.J. Agnes, T. Lillicrap, T.P. Vogels, in:, Advances in Neural Information Processing Systems, 2020, pp. 16398–16408.
[Published Version] View | Files available | Download Published Version (ext.)
 

Filters and Search Terms

issn=1049-5258

Search

Filter Publications

Display / Sort

Export / Embed