A Failed attempt at creating Guidelines for Visual GUI Testing: An industrial case study

↓ Direkt till sidans innehåll
↓ Direkt till sidans sekundära innehåll (sidomenyn)

Search: onr:"swepub:oai:DiVA.org:bth-21820" > A Failed attempt at...

1 of 1
Previous record
Next record
To hitlist

Details
MARC

Alégroth, Emil,1984-Blekinge Tekniska Högskola,Institutionen för programvaruteknik,Blekinge Inst Technol, Sweden (author)

A Failed attempt at creating Guidelines for Visual GUI Testing : An industrial case study

Article/chapterEnglish2021

Publisher, publication year, extent ...

Institute of Electrical and Electronics Engineers Inc.2021
electronicrdacarrier

Numbers

LIBRIS-ID:oai:DiVA.org:bth-21820
https://urn.kb.se/resolve?urn=urn:nbn:se:bth-21820URI
https://doi.org/10.1109/ICST49551.2021.00046DOI
https://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-178565URI

Supplementary language notes

Language:English
Summary in:English

Part of subdatabase

SwePubSwePub

Classification

Subject category:ref swepub-contenttype
Subject category:kon swepub-publicationtype

Notes

open access
Funding Agencies|KKS foundation through the S.E.R.T. Research Profile project; KKS foundation through M.E.T.A. project at Blekinge Institute of Technology
Software development is governed by guidelines that aim to improve the code's qualities, such as maintainability. However, whilst coding guidelines are commonplace for software, guidelines for testware are much less common. In particular, for GUI-based tests driven with image recognition, also referred to as Visual GUI Testing (VGT), explicit coding guidelines are missing.In this industrial case study, performed at the Swedish defence contractor Saab AB, we propose a set of coding guidelines for VGT and evaluate their impact on test scripts for an industrial, safety-critical system. To study the guidelines' effect on maintenance costs, five representative manual test cases are each translated with and without the proposed guidelines in the two VGT tools SikuliX and EyeAutomate. As such, 20 test scripts were developed, with a combined development cost of more than 100 man-hours. Three of the tests are then maintained by one researcher and two practitioners for another version of the system and costs measured to evaluate return on investment. This analysis is complemented with observations and interviews to elicit practitioners' perceptions and experiences with VGT.Results show that scripts developed with the guidelines had higher maintenance costs than scripts developed without guidelines. This is supported by qualitative results that many of the guidelines are considered inappropriate, superfluous or unnecessary due to the inherent properties of the scripts, e.g. their natural small size, linear flows, natural separation of concerns, and more. We conclude that there are differences between VGT scripts and software that prohibit direct translation of guidelines between the two. As such, we consider our study as a failure but argue that several lessons can be drawn from our results to guide future research into guidelines for VGT and GUI-based test automation. © 2021 IEEE.

Subject headings and genre

NATURVETENSKAP Data- och informationsvetenskap Programvaruteknik hsv//swe
NATURAL SCIENCES Computer and Information Sciences Software Engineering hsv//eng
Automated Testing
Case study
Guidelines for testing
Industrial study
Visual GUI testing
Accident prevention
Cost benefit analysis
Costs
Graphical user interfaces
Image coding
Image recognition
Maintenance
Safety testing
Software design
Verification
Defence contractors
Development costs
Industrial case study
Maintenance cost
Safety critical systems
Separation of concerns
Test Automation
Software testing

Added entries (persons, corporate bodies, meetings, titles ...)

Borch Petersen, ElineLinköpings universitet,Avdelningen för Logopedi, Audiologi och Otorhinolaryngologi,Medicinska fakulteten,Linköping University, SWE(Swepub:liu)elibo32 (author)
Tinnerholm, JohnLinköpings universitet,Programvara och system,Tekniska fakulteten,Linköping University, SWE(Swepub:liu)johti17 (author)
Blekinge Tekniska HögskolaInstitutionen för programvaruteknik (creator_code:org_t)

Related titles

In:Proceedings - 2021 IEEE 14th International Conference on Software Testing, Verification and Validation, ICST 2021: Institute of Electrical and Electronics Engineers Inc., s. 340-3509781728168364

Internet link

Find in a library

Proceedings - 2021 IEEE 14th International Conference on Software Testing, Verif... (Search for host publication in LIBRIS)

To the university's database

1 of 1
Previous record
Next record
To hitlist

Find more in SwePub

By the author/editor: Alégroth, Emil, ...; Borch Petersen, ...; Tinnerholm, John

About the subject

NATURAL SCIENCES: NATURAL SCIENCES; and Computer and Inf ...; and Software Enginee ...

Articles in the publication: Proceedings - 20 ...

By the university: Blekinge Institute of Technology; Linköping University

Search outside SwePub

Extend your search to:: Google; Google Book Search; Google Scholar

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.

LIBRIS.kb.se