Online learning of neural computations from sparse temporal feedback

Braun L, Vogels TP. 2021. Online learning of neural computations from sparse temporal feedback. Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems. NeurIPS: Neural Information Processing Systems vol. 20, 16437–16450.

Conference Paper | Published | English

Scopus indexed
Author
Braun, Lukas; Vogels, Tim PISTA

Corresponding author has ISTA affiliation

Department
Abstract
Neuronal computations depend on synaptic connectivity and intrinsic electrophysiological properties. Synaptic connectivity determines which inputs from presynaptic neurons are integrated, while cellular properties determine how inputs are filtered over time. Unlike their biological counterparts, most computational approaches to learning in simulated neural networks are limited to changes in synaptic connectivity. However, if intrinsic parameters change, neural computations are altered drastically. Here, we include the parameters that determine the intrinsic properties, e.g., time constants and reset potential, into the learning paradigm. Using sparse feedback signals that indicate target spike times, and gradient-based parameter updates, we show that the intrinsic parameters can be learned along with the synaptic weights to produce specific input-output functions. Specifically, we use a teacher-student paradigm in which a randomly initialised leaky integrate-and-fire or resonate-and-fire neuron must recover the parameters of a teacher neuron. We show that complex temporal functions can be learned online and without backpropagation through time, relying on event-based updates only. Our results are a step towards online learning of neural computations from ungraded and unsigned sparse feedback signals with a biologically inspired learning mechanism.
Publishing Year
Date Published
2021-12-01
Proceedings Title
Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems
Publisher
Neural Information Processing Systems Foundation
Acknowledgement
We would like to thank Professor Dr. Henning Sprekeler for his valuable suggestions and Dr. Andrew Saxe, Milan Klöwer and Anna Wallis for their constructive feedback on the manuscript. Lukas Braun was supported by the Network of European Neuroscience Schools through their NENS Exchange Grant program, by the European Union through their European Community Action Scheme for the Mobility of University Students, the Woodward Scholarship awarded by Wadham College, Oxford and the Medical Research Council [MR/N013468/1]. Tim P. Vogels was supported by a Wellcome Trust Senior Research Fellowship [214316/Z/18/Z].
Volume
20
Page
16437-16450
Conference
NeurIPS: Neural Information Processing Systems
Conference Location
Virtual, Online
Conference Date
2021-12-06 – 2021-12-14
ISSN
IST-REx-ID

Cite this

Braun L, Vogels TP. Online learning of neural computations from sparse temporal feedback. In: Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems. Vol 20. Neural Information Processing Systems Foundation; 2021:16437-16450.
Braun, L., & Vogels, T. P. (2021). Online learning of neural computations from sparse temporal feedback. In Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems (Vol. 20, pp. 16437–16450). Virtual, Online: Neural Information Processing Systems Foundation.
Braun, Lukas, and Tim P Vogels. “Online Learning of Neural Computations from Sparse Temporal Feedback.” In Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems, 20:16437–50. Neural Information Processing Systems Foundation, 2021.
L. Braun and T. P. Vogels, “Online learning of neural computations from sparse temporal feedback,” in Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems, Virtual, Online, 2021, vol. 20, pp. 16437–16450.
Braun L, Vogels TP. 2021. Online learning of neural computations from sparse temporal feedback. Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems. NeurIPS: Neural Information Processing Systems vol. 20, 16437–16450.
Braun, Lukas, and Tim P. Vogels. “Online Learning of Neural Computations from Sparse Temporal Feedback.” Advances in Neural Information Processing Systems - 35th Conference on Neural Information Processing Systems, vol. 20, Neural Information Processing Systems Foundation, 2021, pp. 16437–50.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]

Link(s) to Main File(s)
Access Level
OA Open Access

Export

Marked Publications

Open Data ISTA Research Explorer

Search this title in

Google Scholar
ISBN Search