SwePub - search: id:"swepub:oai:research.chalme...

Enumeration	Reference	Cover	Find
1.	Berglund, Lukas, et al. (author) Test Maintenance for Machine Learning Systems: A Case Study in the Automotive Industry 2023 In: 2023 IEEE Conference on Software Testing, Verification and Validation (ICST). - 2159-4848. - 9781665456661 ; , s. 410-421 Conference paper (peer-reviewed)abstract Machine Learning (ML) systems have seen widespread use for automated decision making. Testing is essential to ensure the quality of these systems, especially safety-critical autonomous systems in the automotive domain. ML systems introduce new challenges with the potential to affect test maintenance, the process of updating test cases to match the evolving system. We conducted an exploratory case study in the automotive domain to identify factors that affect test maintenance for ML systems, as well as to make recommendations to improve the maintenance process. Based on interview and artifact analysis, we identified 14 factors affecting maintenance, including five especially relevant for ML systems—with the most important relating to non-determinism and large input spaces. We also proposed ten recommendations for improving test maintenance, including four targeting ML systems—in particular, emphasizing the use of test oracles tolerant to acceptable non-determinism. The study’s findings expand our knowledge of test maintenance for an emerging class of systems, benefiting the practitioners testing these systems.

Berglund, Lukas, et al. (author)
Test Maintenance for Machine Learning Systems: A Case Study in the Automotive Industry
2023
In: 2023 IEEE Conference on Software Testing, Verification and Validation (ICST). - 2159-4848. - 9781665456661 ; , s. 410-421
Conference paper (peer-reviewed)abstract
- Machine Learning (ML) systems have seen widespread use for automated decision making. Testing is essential to ensure the quality of these systems, especially safety-critical autonomous systems in the automotive domain. ML systems introduce new challenges with the potential to affect test maintenance, the process of updating test cases to match the evolving system. We conducted an exploratory case study in the automotive domain to identify factors that affect test maintenance for ML systems, as well as to make recommendations to improve the maintenance process. Based on interview and artifact analysis, we identified 14 factors affecting maintenance, including five especially relevant for ML systems—with the most important relating to non-determinism and large input spaces. We also proposed ten recommendations for improving test maintenance, including four targeting ML systems—in particular, emphasizing the use of test oracles tolerant to acceptable non-determinism. The study’s findings expand our knowledge of test maintenance for an emerging class of systems, benefiting the practitioners testing these systems.

Träfflista för sökning "id:"swepub:oai:research.chalmers.se:c003cb86-5025-45bc-ac17-c5e8b9d3a2a7" "