onr:"swepub:oai:DiVA.org:uu-482502"
Search: onr:"swepub:oai:DiVA.org:uu-482502" > Test Benchmarks :
- 1 of 1
- Previous record
- Next record
- To hitlist
- Artho, CyrilleKTH,Teoretisk datalogi, TCS (author)
Test Benchmarks : Which One Now and in Future?
- Article/chapterEnglish2021
Publisher, publication year, extent ...
- Institute of Electrical and Electronics Engineers (IEEE),2021
- printrdacarrier
Numbers
- LIBRIS-ID:oai:DiVA.org:kth-315539
- https://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-315539URI
- https://doi.org/10.1109/QRS54544.2021.00044DOI
Supplementary language notes
- Language:English
- Summary in:English
Part of subdatabase
- SwePubSwePub
Classification
Notes
- Part of proceedings: ISBN 978-1-6654-5813-9QC 20220708
- To evaluate software testing and program analysis tools, the research community relies on collections of sample programs (benchmarks) containing realistic code examples with defects. We investigated 23 benchmark projects for test generation in common programming languages and looked at how they can be categorized according to attributes such as programming language, number of programs and defects, license, and size. From our studies, it is evident that the development and especially maintenance of benchmarks are a big challenge. Out of the 23 benchmark projects we investigated, only four are still active as of today, and only nine have been updated after their initial release. With the underlying programming languages and platforms constantly evolving (often without full backward compatibility), this creates a challenge when comparing new tools to older ones. To exacerbate the situation, many benchmarks do not fully track the provenance and license of the code they include. Sustainable benchmark collections share these key factors: Open hosting of complete (actual) data allowing community involvement, systematic maintenance of license and authorship data, and a unified machine-readable format for such data.
Subject headings and genre
- NATURVETENSKAP Data- och informationsvetenskap Datavetenskap hsv//swe
- NATURAL SCIENCES Computer and Information Sciences Computer Sciences hsv//eng
- Software verification
- software testing
- programming languages
- benchmarks
- software science
- measurement
- maintainability
- licensing
- sustainability
Added entries (persons, corporate bodies, meetings, titles ...)
- Benali, AdamKTH,Teoretisk datalogi, TCS(Swepub:kth)u1lwyga0 (author)
- Ramler, RudolfSoftware Competence Ctr Hagenberg, Hagenberg, Austria. (author)
- KTHTeoretisk datalogi, TCS (creator_code:org_t)
Related titles
- In:2021 IEEE 21ST INTERNATIONAL CONFERENCE ON SOFTWARE QUALITY, RELIABILITY AND SECURITY (QRS 2021): Institute of Electrical and Electronics Engineers (IEEE), s. 328-336
Internet link
To the university's database
- 1 of 1
- Previous record
- Next record
- To hitlist
Find more in SwePub
- By the author/editor
- Artho, Cyrille
- Benali, Adam
- Ramler, Rudolf
- About the subject
-
- NATURAL SCIENCES
- NATURAL SCIENCES
- and Computer and Inf ...
- and Computer Science ...
- Articles in the publication
- 2021 IEEE 21ST I ...
- By the university
- Royal Institute of Technology
Search outside SwePub
- Extend your search to:
- Google Book Search
- Google Scholar
Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.
- Copyright © LIBRIS - National Library Systems
- LIBRIS.kb.se
