Towards a Hybrid Testing Process Unifying Exploratory Testing and Scripted Testing

• Context: Given the current state of the art in research, practitioners are faced with the challenge of choosing scripted testing (ST) or exploratory testing (ET). Objective: This study aims at systematically incorporating strengths of ET and ST in a hybrid testing process to overcome the weaknesses of each. Method: We utilized systematic review and practitioner interviews to identify strengths and weaknesses of ET and ST. Strengths of ET were mapped to weaknesses of ST, and vice versa. Noblit and Hare’s Lines of Argument method was used for data analysis. The results of the mapping were used as input to co-design a hybrid process with experienced practitioners. Results: We found a clear need to create a hybrid process as: 1) both ST and ET provide strengths and weaknesses and these depend on some particular conditions, which prevents preference of one approach to another, and 2) the mapping showed that it is possible to address the weaknesses in one process by the strengths of the other in a hybrid form. With the input from literature and industry experts a flexible and iterative hybrid process was designed. Conclusions: Practitioners can clearly benefit from using a hybrid process given the mapping of advantages and disadvantages.

Ämnesord

Natural Sciences  (hsv)

Computer and Information Sciences  (hsv)

Software Engineering  (hsv)

Naturvetenskap  (hsv)

Data- och informationsvetenskap  (hsv)

Programvaruteknik  (hsv)

Nyckelord

Software Process improvement

Test process

Prescriptive testing

Scripted testing

Test case based testing

Exploratory testing

Ad hoc testing

Empirical study