Search: onr:"swepub:oai:DiVA.org:bth-6727" >
An experiment on th...
An experiment on the effectiveness and efficiency of exploratory testing
-
- Afzal, Wasif (author)
- Mälardalens högskola,Inbyggda system,IS (Embedded Systems)
-
- Ghazi, Ahmad Nauman (author)
- Blekinge Tekniska Högskola,Institutionen för programvaruteknik,Blekinge Institute of Technolog
-
- Itkonen, Juha (author)
- Aalto University, Espoo, Finland
-
show more...
-
- Torkar, Richard (author)
- Gothenburg University,Göteborgs universitet,Blekinge Tekniska Högskola,Institutionen för programvaruteknik,Chalmers University of Technology,Institutionen för data- och informationsteknik (GU),Department of Computer Science and Engineering (GU)
-
- Andrews, Anneliese (author)
- University of Denver, USA
-
- Bhatti, Khurram (author)
- Blekinge Institute of Technolog
-
show less...
-
(creator_code:org_t)
- 2014-04-16
- 2015
- English.
-
In: Empirical Software Engineering. - : Springer. - 1382-3256 .- 1573-7616. ; 20:3, s. 844-878
- Related links:
-
https://bth.diva-por... (primary) (Raw object)
-
show more...
-
http://bth.diva-port...
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
https://urn.kb.se/re...
-
https://gup.ub.gu.se...
-
show less...
Abstract
Subject headings
Close
- The exploratory testing (ET) approach is commonly applied in industry, but lacks scientific research. The scientific community needs quantitative results on the performance of ET taken from realistic experimental settings. The objective of this paper is to quantify the effectiveness and efficiency of ET vs. testing with documented test cases (test case based testing, TCT). We performed four controlled experiments where a total of 24 practitioners and 46 students performed manual functional testing using ET and TCT. We measured the number of identified defects in the 90-minute testing sessions, the detection difficulty, severity and types of the detected defects, and the number of false defect reports. The results show that ET found a significantly greater number of defects. ET also found significantly more defects of varying levels of difficulty, types and severity levels. However, the two testing approaches did not differ significantly in terms of the number of false defect reports submitted. We conclude that ET was more efficient than TCT in our experiment. ET was also more effective than TCT when detection difficulty, type of defects and severity levels are considered. The two approaches are comparable when it comes to the number of false defect reports submitted.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Programvaruteknik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Software Engineering (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences (hsv//eng)
Keyword
- Software testing
- Experiment
- Exploratory testing
- Efficiency
- Effectiveness
- experiment
- exploratory testing
- test case based testing
Publication and Content Type
- ref (subject category)
- art (subject category)
Find in a library
To the university's database