{"abstract":[{"text":"A natural approach to generative modeling of videos is to represent them as a composition of moving objects. Recent works model a set of 2D sprites over a slowly-varying background, but without considering the underlying 3D scene that\r\ngives rise to them. We instead propose to model a video as the view seen while moving through a scene with multiple 3D objects and a 3D background. Our model is trained from monocular videos without any supervision, yet learns to\r\ngenerate coherent 3D scenes containing several moving objects. We conduct detailed experiments on two datasets, going beyond the visual complexity supported by state-of-the-art generative approaches. We evaluate our method on\r\ndepth-prediction and 3D object detection---tasks which cannot be addressed by those earlier works---and show it out-performs them even on 2D instance segmentation and tracking.","lang":"eng"}],"oa":1,"main_file_link":[{"url":"https://arxiv.org/abs/2007.06705","open_access":"1"}],"publication":"34th Conference on Neural Information Processing Systems","intvolume":"        33","quality_controlled":"1","month":"07","department":[{"_id":"ChLa"}],"publication_identifier":{"isbn":["9781713829546"]},"author":[{"orcid":"0000-0002-5198-7445","first_name":"Paul M","id":"13C09E74-18D9-11E9-8878-32CFE5697425","last_name":"Henderson","full_name":"Henderson, Paul M"},{"id":"40C20FD2-F248-11E8-B48F-1D18A9856A87","first_name":"Christoph","orcid":"0000-0001-8622-7887","last_name":"Lampert","full_name":"Lampert, Christoph"}],"publisher":"Curran Associates","article_processing_charge":"No","acknowledgement":"This research was supported by the Scientific Service Units (SSU) of IST Austria through resources\r\nprovided by Scientific Computing (SciComp). PH is employed part-time by Blackford Analysis, but\r\nthey did not support this project in any way.","publication_status":"published","day":"07","acknowledged_ssus":[{"_id":"ScienComp"}],"date_published":"2020-07-07T00:00:00Z","page":"3106–3117","conference":{"start_date":"2020-12-06","end_date":"2020-12-12","location":"Vancouver, Canada","name":"NeurIPS: Neural Information Processing Systems"},"language":[{"iso":"eng"}],"date_created":"2020-07-31T16:59:19Z","status":"public","_id":"8188","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","date_updated":"2023-04-25T09:49:58Z","citation":{"mla":"Henderson, Paul M., and Christoph Lampert. “Unsupervised Object-Centric Video Generation and Decomposition in 3D.” <i>34th Conference on Neural Information Processing Systems</i>, vol. 33, Curran Associates, 2020, pp. 3106–3117.","apa":"Henderson, P. M., &#38; Lampert, C. (2020). Unsupervised object-centric video generation and decomposition in 3D. In <i>34th Conference on Neural Information Processing Systems</i> (Vol. 33, pp. 3106–3117). Vancouver, Canada: Curran Associates.","ieee":"P. M. Henderson and C. Lampert, “Unsupervised object-centric video generation and decomposition in 3D,” in <i>34th Conference on Neural Information Processing Systems</i>, Vancouver, Canada, 2020, vol. 33, pp. 3106–3117.","chicago":"Henderson, Paul M, and Christoph Lampert. “Unsupervised Object-Centric Video Generation and Decomposition in 3D.” In <i>34th Conference on Neural Information Processing Systems</i>, 33:3106–3117. Curran Associates, 2020.","short":"P.M. Henderson, C. Lampert, in:, 34th Conference on Neural Information Processing Systems, Curran Associates, 2020, pp. 3106–3117.","ista":"Henderson PM, Lampert C. 2020. Unsupervised object-centric video generation and decomposition in 3D. 34th Conference on Neural Information Processing Systems. NeurIPS: Neural Information Processing Systems vol. 33, 3106–3117.","ama":"Henderson PM, Lampert C. Unsupervised object-centric video generation and decomposition in 3D. In: <i>34th Conference on Neural Information Processing Systems</i>. Vol 33. Curran Associates; 2020:3106–3117."},"external_id":{"arxiv":["2007.06705"]},"title":"Unsupervised object-centric video generation and decomposition in 3D","volume":33,"oa_version":"Preprint","year":"2020","type":"conference"}