article published yes Konstantin Kueffner author 8121a2d0-dc85-11ea-9058-af578f3b45150000-0001-8974-2542 Anna Lukina author CBA4D1A8-0FE8-11E9-BDE6-07BFE5697425 Christian Schilling author 3A2F4DCE-F248-11E8-B48F-1D18A9856A870000-0003-3658-1065 Thomas A Henzinger author 40876CD8-F248-11E8-B48F-1D18A9856A870000-0002-2985-7724 ToHe department Vigilant Algorithmic Monitoring of Software project Neural-network classifiers achieve high accuracy when predicting the class of an input that they were trained to identify. Maintaining this accuracy in dynamic environments, where inputs frequently fall outside the fixed set of initially known classes, remains a challenge. We consider the problem of monitoring the classification decisions of neural networks in the presence of novel classes. For this purpose, we generalize our recently proposed abstraction-based monitor from binary output to real-valued quantitative output. This quantitative output enables new applications, two of which we investigate in the paper. As our first application, we introduce an algorithmic framework for active monitoring of a neural network, which allows us to learn new classes dynamically and yet maintain high monitoring performance. As our second application, we present an offline procedure to retrain the neural network to improve the monitor’s detection performance without deteriorating the network’s classification accuracy. Our experimental evaluation demonstrates both the benefits of our active monitoring framework in dynamic scenarios and the effectiveness of the retraining procedure. https://research-explorer.ista.ac.at/download/13234/14903/2023_JourSoftwareTools_Kueffner.pdf application/pdfno Springer Nature2023 eng 1433-2779 1433-2787 2009.06429 00102016000000110.1007/s10009-023-00711-4 25575-592 https://research-explorer.ista.ac.at/record/10206 Kueffner K, Lukina A, Schilling C, Henzinger TA. 2023. Into the unknown: Active monitoring of neural networks (extended version). International Journal on Software Tools for Technology Transfer. 25, 575–592. K. Kueffner, A. Lukina, C. Schilling, T.A. Henzinger, International Journal on Software Tools for Technology Transfer 25 (2023) 575–592. Kueffner, Konstantin, et al. “Into the Unknown: Active Monitoring of Neural Networks (Extended Version).” <i>International Journal on Software Tools for Technology Transfer</i>, vol. 25, Springer Nature, 2023, pp. 575–92, doi:<a href="https://doi.org/10.1007/s10009-023-00711-4">10.1007/s10009-023-00711-4</a>. Kueffner, Konstantin, Anna Lukina, Christian Schilling, and Thomas A Henzinger. “Into the Unknown: Active Monitoring of Neural Networks (Extended Version).” <i>International Journal on Software Tools for Technology Transfer</i>. Springer Nature, 2023. <a href="https://doi.org/10.1007/s10009-023-00711-4">https://doi.org/10.1007/s10009-023-00711-4</a>. Kueffner, K., Lukina, A., Schilling, C., &#38; Henzinger, T. A. (2023). Into the unknown: Active monitoring of neural networks (extended version). <i>International Journal on Software Tools for Technology Transfer</i>. Springer Nature. <a href="https://doi.org/10.1007/s10009-023-00711-4">https://doi.org/10.1007/s10009-023-00711-4</a> Kueffner K, Lukina A, Schilling C, Henzinger TA. Into the unknown: Active monitoring of neural networks (extended version). <i>International Journal on Software Tools for Technology Transfer</i>. 2023;25:575-592. doi:<a href="https://doi.org/10.1007/s10009-023-00711-4">10.1007/s10009-023-00711-4</a> K. Kueffner, A. Lukina, C. Schilling, and T. A. Henzinger, “Into the unknown: Active monitoring of neural networks (extended version),” <i>International Journal on Software Tools for Technology Transfer</i>, vol. 25. Springer Nature, pp. 575–592, 2023. 132342023-07-16T22:01:11Z2025-04-15T06:55:00Z