{"title":"Sample complexity bounds for score-matching: Causal discovery and generative modeling","_id":"14953","language":[{"iso":"eng"}],"article_processing_charge":"No","doi":"10.48550/arXiv.2310.18123","acknowledgement":"We are thankful to the reviewers for providing constructive feedback and Kun Zhang and Dominik Janzing for helpful discussion on the special case of deterministic children. This work was supported by Hasler Foundation Program: Hasler Responsible AI (project number 21043). This work was supported by the Swiss National Science Foundation (SNSF) under grant number 200021_205011. Francesco Locatello did not contribute to this work at Amazon. ","oa_version":"Preprint","oa":1,"external_id":{"arxiv":["2310.18123"]},"day":"27","main_file_link":[{"open_access":"1","url":"https://doi.org/10.48550/arXiv.2310.18123"}],"publication":"arXiv","abstract":[{"lang":"eng","text":"This paper provides statistical sample complexity bounds for score-matching and its applications in causal discovery. We demonstrate that accurate estimation of the score function is achievable by training a standard deep ReLU neural network using stochastic gradient descent. We establish bounds on the error rate of recovering causal relationships using the score-matching-based causal discovery method of Rolland et al. [2022], assuming a sufficiently good estimation of the score function. Finally, we analyze the upper bound of score-matching estimation within the score-based generative modeling, which has been applied for causal discovery but is also of independent interest within the domain of generative models."}],"citation":{"mla":"Zhu, Zhenyu, et al. “Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modeling.” ArXiv, 2310.18123, doi:10.48550/arXiv.2310.18123.","ista":"Zhu Z, Locatello F, Cevher V. Sample complexity bounds for score-matching: Causal discovery and generative modeling. arXiv, 2310.18123.","short":"Z. Zhu, F. Locatello, V. Cevher, ArXiv (n.d.).","chicago":"Zhu, Zhenyu, Francesco Locatello, and Volkan Cevher. “Sample Complexity Bounds for Score-Matching: Causal Discovery and Generative Modeling.” ArXiv, n.d. https://doi.org/10.48550/arXiv.2310.18123.","ama":"Zhu Z, Locatello F, Cevher V. Sample complexity bounds for score-matching: Causal discovery and generative modeling. arXiv. doi:10.48550/arXiv.2310.18123","ieee":"Z. Zhu, F. Locatello, and V. Cevher, “Sample complexity bounds for score-matching: Causal discovery and generative modeling,” arXiv. .","apa":"Zhu, Z., Locatello, F., & Cevher, V. (n.d.). Sample complexity bounds for score-matching: Causal discovery and generative modeling. arXiv. https://doi.org/10.48550/arXiv.2310.18123"},"date_created":"2024-02-07T15:11:11Z","publication_status":"submitted","author":[{"full_name":"Zhu, Zhenyu","last_name":"Zhu","first_name":"Zhenyu"},{"id":"26cfd52f-2483-11ee-8040-88983bcc06d4","last_name":"Locatello","first_name":"Francesco","orcid":"0000-0002-4850-0683","full_name":"Locatello, Francesco"},{"last_name":"Cevher","first_name":"Volkan","full_name":"Cevher, Volkan"}],"department":[{"_id":"FrLo"}],"month":"10","date_updated":"2024-02-12T09:45:58Z","year":"2023","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","status":"public","article_number":"2310.18123","date_published":"2023-10-27T00:00:00Z","type":"preprint"}