{"publisher":"Public Library of Science","abstract":[{"text":"A central goal in systems neuroscience is to understand the functions performed by neural circuits. Previous top-down models addressed this question by comparing the behaviour of an ideal model circuit, optimised to perform a given function, with neural recordings. However, this requires guessing in advance what function is being performed, which may not be possible for many neural systems. To address this, we propose an inverse reinforcement learning (RL) framework for inferring the function performed by a neural network from data. We assume that the responses of each neuron in a network are optimised so as to drive the network towards ‘rewarded’ states, that are desirable for performing a given function. We then show how one can use inverse RL to infer the reward function optimised by the network from observing its responses. This inferred reward function can be used to predict how the neural network should adapt its dynamics to perform the same function when the external environment or network structure changes. This could lead to theoretical predictions about how neural network dynamics adapt to deal with cell death and/or varying sensory stimulus statistics.","lang":"eng"}],"article_processing_charge":"No","language":[{"iso":"eng"}],"issue":"4","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","file_date_updated":"2021-05-04T13:22:19Z","doi":"10.1371/journal.pone.0248940","scopus_import":"1","citation":{"ama":"Chalk MJ, Tkačik G, Marre O. Inferring the function performed by a recurrent neural network. <i>PLoS ONE</i>. 2021;16(4). doi:<a href=\"https://doi.org/10.1371/journal.pone.0248940\">10.1371/journal.pone.0248940</a>","ieee":"M. J. Chalk, G. Tkačik, and O. Marre, “Inferring the function performed by a recurrent neural network,” <i>PLoS ONE</i>, vol. 16, no. 4. Public Library of Science, 2021.","chicago":"Chalk, Matthew J, Gašper Tkačik, and Olivier Marre. “Inferring the Function Performed by a Recurrent Neural Network.” <i>PLoS ONE</i>. Public Library of Science, 2021. <a href=\"https://doi.org/10.1371/journal.pone.0248940\">https://doi.org/10.1371/journal.pone.0248940</a>.","short":"M.J. Chalk, G. Tkačik, O. Marre, PLoS ONE 16 (2021).","apa":"Chalk, M. J., Tkačik, G., &#38; Marre, O. (2021). Inferring the function performed by a recurrent neural network. <i>PLoS ONE</i>. Public Library of Science. <a href=\"https://doi.org/10.1371/journal.pone.0248940\">https://doi.org/10.1371/journal.pone.0248940</a>","mla":"Chalk, Matthew J., et al. “Inferring the Function Performed by a Recurrent Neural Network.” <i>PLoS ONE</i>, vol. 16, no. 4, e0248940, Public Library of Science, 2021, doi:<a href=\"https://doi.org/10.1371/journal.pone.0248940\">10.1371/journal.pone.0248940</a>.","ista":"Chalk MJ, Tkačik G, Marre O. 2021. Inferring the function performed by a recurrent neural network. PLoS ONE. 16(4), e0248940."},"day":"15","status":"public","publication_identifier":{"eissn":["19326203"]},"date_published":"2021-04-15T00:00:00Z","quality_controlled":"1","external_id":{"pmid":["33857170"],"isi":["000641474900072"]},"publication":"PLoS ONE","has_accepted_license":"1","file":[{"date_created":"2021-05-04T13:22:19Z","content_type":"application/pdf","file_name":"2021_pone_Chalk.pdf","success":1,"file_id":"9371","relation":"main_file","date_updated":"2021-05-04T13:22:19Z","creator":"kschuh","file_size":2768282,"checksum":"c52da133850307d2031f552d998f00e8","access_level":"open_access"}],"intvolume":"        16","article_type":"original","isi":1,"tmp":{"short":"CC BY (4.0)","name":"Creative Commons Attribution 4.0 International Public License (CC-BY 4.0)","legal_code_url":"https://creativecommons.org/licenses/by/4.0/legalcode","image":"/images/cc_by.png"},"acknowledgement":"The authors would like to thank Ulisse Ferrari for useful discussions and feedback.","oa_version":"Published Version","oa":1,"pmid":1,"publication_status":"published","type":"journal_article","article_number":"e0248940","year":"2021","author":[{"id":"2BAAC544-F248-11E8-B48F-1D18A9856A87","first_name":"Matthew J","last_name":"Chalk","full_name":"Chalk, Matthew J","orcid":"0000-0001-7782-4436"},{"full_name":"Tkačik, Gašper","last_name":"Tkačik","first_name":"Gašper","id":"3D494DCA-F248-11E8-B48F-1D18A9856A87","orcid":"0000-0002-6699-1455"},{"last_name":"Marre","full_name":"Marre, Olivier","first_name":"Olivier"}],"ddc":["570"],"_id":"9362","title":"Inferring the function performed by a recurrent neural network","department":[{"_id":"GaTk"}],"date_created":"2021-05-02T22:01:28Z","month":"04","date_updated":"2023-10-18T08:17:42Z","volume":16}