Search: onr:"swepub:oai:DiVA.org:uu-482502" >
Test Benchmarks :
-
Artho, CyrilleKTH,Teoretisk datalogi, TCS
(author)
Test Benchmarks : Which One Now and in Future?
- Article/chapterEnglish2021
Publisher, publication year, extent ...
-
Institute of Electrical and Electronics Engineers (IEEE),2021
-
printrdacarrier
Numbers
-
LIBRIS-ID:oai:DiVA.org:kth-315539
-
https://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-315539URI
-
https://doi.org/10.1109/QRS54544.2021.00044DOI
Supplementary language notes
-
Language:English
-
Summary in:English
Part of subdatabase
Classification
-
Subject category:ref swepub-contenttype
-
Subject category:kon swepub-publicationtype
Notes
-
Part of proceedings: ISBN 978-1-6654-5813-9QC 20220708
-
To evaluate software testing and program analysis tools, the research community relies on collections of sample programs (benchmarks) containing realistic code examples with defects. We investigated 23 benchmark projects for test generation in common programming languages and looked at how they can be categorized according to attributes such as programming language, number of programs and defects, license, and size. From our studies, it is evident that the development and especially maintenance of benchmarks are a big challenge. Out of the 23 benchmark projects we investigated, only four are still active as of today, and only nine have been updated after their initial release. With the underlying programming languages and platforms constantly evolving (often without full backward compatibility), this creates a challenge when comparing new tools to older ones. To exacerbate the situation, many benchmarks do not fully track the provenance and license of the code they include. Sustainable benchmark collections share these key factors: Open hosting of complete (actual) data allowing community involvement, systematic maintenance of license and authorship data, and a unified machine-readable format for such data.
Subject headings and genre
Added entries (persons, corporate bodies, meetings, titles ...)
-
Benali, AdamKTH,Teoretisk datalogi, TCS(Swepub:kth)u1lwyga0
(author)
-
Ramler, RudolfSoftware Competence Ctr Hagenberg, Hagenberg, Austria.
(author)
-
KTHTeoretisk datalogi, TCS
(creator_code:org_t)
Related titles
-
In:2021 IEEE 21ST INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY (QRS 2021): Institute of Electrical and Electronics Engineers (IEEE), s. 328-336
Internet link
To the university's database