{"publication_status":"published","date_created":"2023-09-13T12:43:14Z","month":"07","year":"2021","abstract":[{"lang":"eng","text":"Learning data representations that are useful for various downstream tasks is a cornerstone of artificial intelligence. While existing methods are typically evaluated on downstream tasks such as classification or generative image quality, we propose to assess representations through their usefulness in downstream control tasks, such as reaching or pushing objects. By training over 10,000 reinforcement learning policies, we extensively evaluate to what extent different representation properties affect out-of-distribution (OOD) generalization. Finally, we demonstrate zero-shot transfer of these policies from simulation to the real world, without any domain randomization or fine-tuning. This paper aims to establish the first systematic characterization of the usefulness of learned representations for real-world OOD downstream tasks."}],"day":"23","language":[{"iso":"eng"}],"publication":"ICML 2021 Workshop on Unsupervised Reinforcement Learning","author":[{"full_name":"Träuble, Frederik","first_name":"Frederik","last_name":"Träuble"},{"full_name":"Dittadi, Andrea","first_name":"Andrea","last_name":"Dittadi"},{"first_name":"Manuel","last_name":"Wuthrich","full_name":"Wuthrich, Manuel"},{"full_name":"Widmaier, Felix","first_name":"Felix","last_name":"Widmaier"},{"full_name":"Gehler, Peter Vincent","last_name":"Gehler","first_name":"Peter Vincent"},{"last_name":"Winther","first_name":"Ole","full_name":"Winther, Ole"},{"last_name":"Locatello","orcid":"0000-0002-4850-0683","first_name":"Francesco","id":"26cfd52f-2483-11ee-8040-88983bcc06d4","full_name":"Locatello, Francesco"},{"last_name":"Bachem","first_name":"Olivier","full_name":"Bachem, Olivier"},{"full_name":"Schölkopf, Bernhard","first_name":"Bernhard","last_name":"Schölkopf"},{"last_name":"Bauer","first_name":"Stefan","full_name":"Bauer, Stefan"}],"article_processing_charge":"No","citation":{"mla":"Träuble, Frederik, et al. “Representation Learning for Out-of-Distribution Generalization in Reinforcement Learning.” <i>ICML 2021 Workshop on Unsupervised Reinforcement Learning</i>, 2021.","ista":"Träuble F, Dittadi A, Wuthrich M, Widmaier F, Gehler PV, Winther O, Locatello F, Bachem O, Schölkopf B, Bauer S. 2021. Representation learning for out-of-distribution generalization in reinforcement learning. ICML 2021 Workshop on Unsupervised Reinforcement Learning. ICML: International Conference on Machine Learning.","ieee":"F. Träuble <i>et al.</i>, “Representation learning for out-of-distribution generalization in reinforcement learning,” in <i>ICML 2021 Workshop on Unsupervised Reinforcement Learning</i>, Virtual, 2021.","short":"F. Träuble, A. Dittadi, M. Wuthrich, F. Widmaier, P.V. Gehler, O. Winther, F. Locatello, O. Bachem, B. Schölkopf, S. Bauer, in:, ICML 2021 Workshop on Unsupervised Reinforcement Learning, 2021.","chicago":"Träuble, Frederik, Andrea Dittadi, Manuel Wuthrich, Felix Widmaier, Peter Vincent Gehler, Ole Winther, Francesco Locatello, Olivier Bachem, Bernhard Schölkopf, and Stefan Bauer. “Representation Learning for Out-of-Distribution Generalization in Reinforcement Learning.” In <i>ICML 2021 Workshop on Unsupervised Reinforcement Learning</i>, 2021.","ama":"Träuble F, Dittadi A, Wuthrich M, et al. Representation learning for out-of-distribution generalization in reinforcement learning. In: <i>ICML 2021 Workshop on Unsupervised Reinforcement Learning</i>. ; 2021.","apa":"Träuble, F., Dittadi, A., Wuthrich, M., Widmaier, F., Gehler, P. V., Winther, O., … Bauer, S. (2021). Representation learning for out-of-distribution generalization in reinforcement learning. In <i>ICML 2021 Workshop on Unsupervised Reinforcement Learning</i>. Virtual."},"title":"Representation learning for out-of-distribution generalization in reinforcement learning","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","date_updated":"2023-09-13T12:44:00Z","type":"conference","oa_version":"None","department":[{"_id":"FrLo"}],"quality_controlled":"1","conference":{"name":"ICML: International Conference on Machine Learning","start_date":"2021-07-23","end_date":"2021-07-23","location":"Virtual"},"status":"public","date_published":"2021-07-23T00:00:00Z","_id":"14332","extern":"1"}