Nardin, MicheleISTA ; Phillips, James W.; Podlaski, William F.; Keemink, Sander W.
The brain efficiently performs nonlinear computations through its intricate networks of spiking neurons, but how this is done remains elusive. While nonlinear computations can be implemented successfully in spiking neural networks, this requires supervised training and the resulting connectivity can be hard to interpret. In contrast, the required connectivity for any computation in the form of a linear dynamical system can be directly derived and understood with the spike coding network (SCN) framework. These networks also have biologically realistic activity patterns and are highly robust to cell death. Here we extend the SCN framework to directly implement any polynomial dynamical system, without the need for training. This results in networks requiring a mix of synapse types (fast, slow, and multiplicative), which we term multiplicative spike coding networks (mSCNs). Using mSCNs, we demonstrate how to directly derive the required connectivity for several nonlinear dynamical systems. We also show how to carry out higher-order polynomials with coupled networks that use only pair-wise multiplicative synapses, and provide expected numbers of connections for each synapse type. Overall, our work demonstrates a novel method for implementing nonlinear computations in spiking neural networks, while keeping the attractive features of standard SCNs (robustness, realistic activity patterns, and interpretable connectivity). Finally, we discuss the biological plausibility of our approach, and how the high accuracy and robustness of the approach may be of interest for neuromorphic computing.
Peer Community Journal
A preprint version of this article has been peer-reviewed and recommended by Peer Community In Neuroscience (DOI link to the recommendation: https://doi.org/10.24072/pci.cneuro.100003). We thank Christian Machens and Nuno Calaim for useful discussions on the project. This report came out of a collaboration started at the CAJAL Advanced Neuroscience Training Programme in Computational Neuroscience in Lisbon, Portugal, during the 2019 summer. The authors would like to thank the participants, TAs, lecturers, and organizers of the summer school. SWK was supported by the Simons Collaboration on the Global Brain (543009). WFP was supported by FCT (032077). MN was supported by European Union Horizon 2020 (665385).
Nardin M, Phillips JW, Podlaski WF, Keemink SW. Nonlinear computations in spiking neural networks through multiplicative synapses. Peer Community Journal. 2021;1. doi:10.24072/pcjournal.69
Nardin, M., Phillips, J. W., Podlaski, W. F., & Keemink, S. W. (2021). Nonlinear computations in spiking neural networks through multiplicative synapses. Peer Community Journal. Centre Mersenne ; Peer Community In. https://doi.org/10.24072/pcjournal.69
Nardin, Michele, James W. Phillips, William F. Podlaski, and Sander W. Keemink. “Nonlinear Computations in Spiking Neural Networks through Multiplicative Synapses.” Peer Community Journal. Centre Mersenne ; Peer Community In, 2021. https://doi.org/10.24072/pcjournal.69.
M. Nardin, J. W. Phillips, W. F. Podlaski, and S. W. Keemink, “Nonlinear computations in spiking neural networks through multiplicative synapses,” Peer Community Journal, vol. 1. Centre Mersenne ; Peer Community In, 2021.
Nardin M, Phillips JW, Podlaski WF, Keemink SW. 2021. Nonlinear computations in spiking neural networks through multiplicative synapses. Peer Community Journal. 1, e68.
Nardin, Michele, et al. “Nonlinear Computations in Spiking Neural Networks through Multiplicative Synapses.” Peer Community Journal, vol. 1, e68, Centre Mersenne ; Peer Community In, 2021, doi:10.24072/pcjournal.69.
All files available under the following license(s):
Creative Commons Attribution 4.0 International Public License (CC-BY 4.0):
10_24072_pcjournal_69.pdf 3.31 MB