{"year":"2023","citation":{"ama":"Burg M, Wenzel F, Zietlow D, et al. Image retrieval outperforms diffusion models on data augmentation. <i>Journal of Machine Learning Research</i>. 2023.","ista":"Burg M, Wenzel F, Zietlow D, Horn M, Makansi O, Locatello F, Russell C. 2023. Image retrieval outperforms diffusion models on data augmentation. Journal of Machine Learning Research.","ieee":"M. Burg <i>et al.</i>, “Image retrieval outperforms diffusion models on data augmentation,” <i>Journal of Machine Learning Research</i>. ML Research Press, 2023.","chicago":"Burg, Max, Florian Wenzel, Dominik Zietlow, Max Horn, Osama Makansi, Francesco Locatello, and Chris Russell. “Image Retrieval Outperforms Diffusion Models on Data Augmentation.” <i>Journal of Machine Learning Research</i>. ML Research Press, 2023.","apa":"Burg, M., Wenzel, F., Zietlow, D., Horn, M., Makansi, O., Locatello, F., &#38; Russell, C. (2023). Image retrieval outperforms diffusion models on data augmentation. <i>Journal of Machine Learning Research</i>. ML Research Press.","mla":"Burg, Max, et al. “Image Retrieval Outperforms Diffusion Models on Data Augmentation.” <i>Journal of Machine Learning Research</i>, ML Research Press, 2023.","short":"M. Burg, F. Wenzel, D. Zietlow, M. Horn, O. Makansi, F. Locatello, C. Russell, Journal of Machine Learning Research (2023)."},"title":"Image retrieval outperforms diffusion models on data augmentation","file_date_updated":"2024-02-07T14:57:32Z","type":"journal_article","department":[{"_id":"FrLo"}],"ddc":["000"],"language":[{"iso":"eng"}],"file":[{"checksum":"af87ddea7908923426365347b9c87ba7","date_created":"2024-02-07T14:57:32Z","file_id":"14950","date_updated":"2024-02-07T14:57:32Z","file_size":27325153,"file_name":"Burg_et_al_2023_Image_retrieval_outperforms.pdf","creator":"ptazenko","content_type":"application/pdf","access_level":"open_access","relation":"main_file"}],"author":[{"first_name":"Max","last_name":"Burg","full_name":"Burg, Max"},{"first_name":"Florian","last_name":"Wenzel","full_name":"Wenzel, Florian"},{"full_name":"Zietlow, Dominik","last_name":"Zietlow","first_name":"Dominik"},{"full_name":"Horn, Max","last_name":"Horn","first_name":"Max"},{"first_name":"Osama","full_name":"Makansi, Osama","last_name":"Makansi"},{"id":"26cfd52f-2483-11ee-8040-88983bcc06d4","last_name":"Locatello","full_name":"Locatello, Francesco","first_name":"Francesco","orcid":"0000-0002-4850-0683"},{"full_name":"Russell, Chris","last_name":"Russell","first_name":"Chris"}],"article_type":"original","month":"12","publication_identifier":{"eissn":["2835-8856"]},"status":"public","abstract":[{"lang":"eng","text":"Many approaches have been proposed to use diffusion models to augment training datasets for downstream tasks, such as classification. However, diffusion models are themselves trained on large datasets, often with noisy annotations, and it remains an open question to which extent these models contribute to downstream classification performance. In particular, it remains unclear if they generalize enough to improve over directly using the additional data of their pre-training process for augmentation. We systematically evaluate a range of existing methods to generate images from diffusion models and study new extensions to assess their benefit for data augmentation. Personalizing diffusion models towards the target data outperforms simpler prompting strategies. However, using the pre-training data of the diffusion model alone, via a simple nearest-neighbor retrieval procedure, leads to even stronger downstream performance. Our study explores the potential of diffusion models in generating new training data, and surprisingly finds that these sophisticated models are not yet able to beat a simple and strong image retrieval baseline on simple downstream vision tasks."}],"publication":"Journal of Machine Learning Research","date_published":"2023-12-10T00:00:00Z","oa_version":"Published Version","tmp":{"image":"/images/cc_by.png","short":"CC BY (4.0)","legal_code_url":"https://creativecommons.org/licenses/by/4.0/legalcode","name":"Creative Commons Attribution 4.0 International Public License (CC-BY 4.0)"},"date_updated":"2024-02-12T08:30:21Z","has_accepted_license":"1","article_processing_charge":"No","alternative_title":["TMLR"],"user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","date_created":"2024-02-07T14:57:39Z","publication_status":"published","day":"10","quality_controlled":"1","main_file_link":[{"url":"https://openreview.net/forum?id=xflYdGZMpv","open_access":"1"}],"_id":"14949","acknowledgement":"The authors would like to thank Varad Gunjal and Vishaal Udandarao. MFB thanks the International Max Planck Research School for Intelligent Systems (IMPRS-IS).","publisher":"ML Research Press","oa":1}