{"conference":{"end_date":"2025-12-18","location":"Hong Kong, Hong Kong","start_date":"2025-12-15","name":"SA: SIGGRAPH Asia"},"license":"https://creativecommons.org/licenses/by-nc/4.0/","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","publisher":"Association for Computing Machinery","article_number":"108","status":"public","author":[{"last_name":"Rao","full_name":"Rao, Pramod","first_name":"Pramod"},{"last_name":"Meka","full_name":"Meka, Abhimitra","first_name":"Abhimitra"},{"full_name":"Zhou, Xilong","first_name":"Xilong","last_name":"Zhou"},{"last_name":"Fox","full_name":"Fox, Gereon","first_name":"Gereon"},{"first_name":"B. R.","full_name":"Mallikarjun, B. R.","last_name":"Mallikarjun"},{"last_name":"Zhan","first_name":"Fangneng","full_name":"Zhan, Fangneng"},{"full_name":"Weyrich, Tim","first_name":"Tim","last_name":"Weyrich"},{"id":"49876194-F248-11E8-B48F-1D18A9856A87","orcid":"0000-0001-6511-9385","last_name":"Bickel","first_name":"Bernd","full_name":"Bickel, Bernd"},{"first_name":"Hanspeter","full_name":"Pfister, Hanspeter","last_name":"Pfister"},{"last_name":"Matusik","full_name":"Matusik, Wojciech","first_name":"Wojciech"},{"first_name":"Thabo","full_name":"Beeler, Thabo","last_name":"Beeler"},{"first_name":"Mohamed","full_name":"Elgharib, Mohamed","last_name":"Elgharib"},{"full_name":"Habermann, Marc","first_name":"Marc","last_name":"Habermann"},{"first_name":"Christian","full_name":"Theobalt, Christian","last_name":"Theobalt"}],"title":"3DPR: Single image 3D portrait relighting with generative priors","doi":"10.1145/3757377.3763962","year":"2025","external_id":{"arxiv":["2510.15846"]},"date_created":"2026-03-22T23:04:35Z","OA_place":"publisher","citation":{"mla":"Rao, Pramod, et al. “3DPR: Single Image 3D Portrait Relighting with Generative Priors.” <i>Proceedings SIGGRAPH Asia 2025 Conference Papers 2025</i>, 108, Association for Computing Machinery, 2025, doi:<a href=\"https://doi.org/10.1145/3757377.3763962\">10.1145/3757377.3763962</a>.","apa":"Rao, P., Meka, A., Zhou, X., Fox, G., Mallikarjun, B. R., Zhan, F., … Theobalt, C. (2025). 3DPR: Single image 3D portrait relighting with generative priors. In <i>Proceedings SIGGRAPH Asia 2025 Conference Papers 2025</i>. Hong Kong, Hong Kong: Association for Computing Machinery. <a href=\"https://doi.org/10.1145/3757377.3763962\">https://doi.org/10.1145/3757377.3763962</a>","chicago":"Rao, Pramod, Abhimitra Meka, Xilong Zhou, Gereon Fox, B. R. Mallikarjun, Fangneng Zhan, Tim Weyrich, et al. “3DPR: Single Image 3D Portrait Relighting with Generative Priors.” In <i>Proceedings SIGGRAPH Asia 2025 Conference Papers 2025</i>. Association for Computing Machinery, 2025. <a href=\"https://doi.org/10.1145/3757377.3763962\">https://doi.org/10.1145/3757377.3763962</a>.","ieee":"P. Rao <i>et al.</i>, “3DPR: Single image 3D portrait relighting with generative priors,” in <i>Proceedings SIGGRAPH Asia 2025 Conference Papers 2025</i>, Hong Kong, Hong Kong, 2025.","ama":"Rao P, Meka A, Zhou X, et al. 3DPR: Single image 3D portrait relighting with generative priors. In: <i>Proceedings SIGGRAPH Asia 2025 Conference Papers 2025</i>. Association for Computing Machinery; 2025. doi:<a href=\"https://doi.org/10.1145/3757377.3763962\">10.1145/3757377.3763962</a>","short":"P. Rao, A. Meka, X. Zhou, G. Fox, B.R. Mallikarjun, F. Zhan, T. Weyrich, B. Bickel, H. Pfister, W. Matusik, T. Beeler, M. Elgharib, M. Habermann, C. Theobalt, in:, Proceedings SIGGRAPH Asia 2025 Conference Papers 2025, Association for Computing Machinery, 2025.","ista":"Rao P, Meka A, Zhou X, Fox G, Mallikarjun BR, Zhan F, Weyrich T, Bickel B, Pfister H, Matusik W, Beeler T, Elgharib M, Habermann M, Theobalt C. 2025. 3DPR: Single image 3D portrait relighting with generative priors. Proceedings SIGGRAPH Asia 2025 Conference Papers 2025. SA: SIGGRAPH Asia, 108."},"department":[{"_id":"BeBi"}],"publication":"Proceedings SIGGRAPH Asia 2025 Conference Papers 2025","scopus_import":"1","date_published":"2025-12-14T00:00:00Z","publication_identifier":{"isbn":["9798400721373"]},"file":[{"date_updated":"2026-03-23T14:41:07Z","checksum":"a3dc426cdf7bbd84a192e5140bb3bb49","creator":"dernst","file_size":57903731,"success":1,"access_level":"open_access","relation":"main_file","file_id":"21479","date_created":"2026-03-23T14:41:07Z","file_name":"2025_SiggraphAsia_Rao.pdf","content_type":"application/pdf"}],"publication_status":"published","article_processing_charge":"No","date_updated":"2026-03-23T14:45:58Z","abstract":[{"lang":"eng","text":"Rendering novel, relit views of a human head, given a monocular portrait image as input, is an inherently underconstrained problem. The traditional graphics solution is to explicitly decompose the input image into geometry, material and lighting via differentiable rendering; but this is constrained by the multiple assumptions and approximations of the underlying models and parameterizations of these scene components. We propose 3DPR, an image-based relighting model that leverages generative priors learnt from multi-view One-Light-at-A-Time (OLAT) images captured in a light stage. We introduce a new diverse and large-scale multi-view 4K OLAT dataset of 139 subjects to learn a high-quality prior over the distribution of high-frequency face reflectance. We leverage the latent space of a pre-trained generative head model that provides a rich prior over face geometry learnt from in-the-wild image datasets. The input portrait is first embedded in the latent manifold of such a model through an encoder-based inversion process. Then a novel triplane-based reflectance network trained on our lightstage data is used to synthesize high-fidelity OLAT images to enable image-based relighting. Our reflectance network operates in the latent space of the generative head model, crucially enabling a relatively small number of lightstage images to train the reflectance model. Combining the generated OLATs according to a given HDRI environment maps yields physically accurate environmental relighting results. Through quantitative and qualitative evaluations, we demonstrate that 3DPR outperforms previous methods, particularly in preserving identity and in capturing lighting effects such as specularities, self-shadows, and subsurface scattering."}],"language":[{"iso":"eng"}],"ddc":["000"],"oa_version":"Published Version","arxiv":1,"type":"conference","tmp":{"legal_code_url":"https://creativecommons.org/licenses/by-nc/4.0/legalcode","name":"Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)","short":"CC BY-NC (4.0)","image":"/images/cc_by_nc.png"},"oa":1,"OA_type":"gold","acknowledgement":"This work was supported by the ERC Consolidator Grant 4DReply (770784) and Saarbrücken Research Center for Visual Comput- ing, Interaction, and AI. We thank Oleksandr Sotnychenko for helping us with setting up data capture. Finally, we thank Shrisha Bharadwaj for discussions, proofreading and innumerable support.","_id":"21474","file_date_updated":"2026-03-23T14:41:07Z","quality_controlled":"1","has_accepted_license":"1","day":"14","month":"12"}