| 1. |
- Bures, Miroslav, et al.
(författare)
-
PatrIoT: IoT Automated Interoperability and Integration Testing Framework
- 2021
-
Ingår i: IEEE International Conference on Software Testing Verification and Validation. - : IEEE. ; , s. 454-459
-
Konferensbidrag (refereegranskat)abstract
- With the rapid growth of the contemporary Internet of Things (IoT) market, the established systems raise a number of concerns regarding the reliability and the potential presence of critical integration defects. In this paper, we present a PatrIoT framework that aims to provide flexible support to construct an effective IoT system testbed to implement automated interoperability and integration testing. The framework allows scaling from a pure physical testbed to a simulated environment using a number of predefined modules and elements to simulate an IoT device or part of the tested infrastructure. PatrIoT also contains a set of reference example testbeds and several sets of example automated tests for a smart street use case.
|
|
| 2. |
- Bures, Miroslav, et al.
(författare)
-
Testing the Usability and Accessibility of Smart TV Applications Using an Automated Model-based Approach
- 2020
-
Ingår i: IEEE transactions on consumer electronics. - : IEEE. - 0098-3063 .- 1558-4127. ; 66:2, s. 134-143
-
Tidskriftsartikel (refereegranskat)abstract
- As the popularity of Smart Televisions (TVs) and interactive Smart TV applications (apps) has recently grown, the usability of these apps has become an important quality characteristic. Previous studies examined Smart TV apps from a usability perspective. However, these methods are mainly manual, and the potential of automated model-based testing methods for usability testing purposes has not yet been fully explored. In this paper, we propose an approach to test the usability of Smart TV apps based on the automated generation of a Smart TV user interaction model from an existing app by a specialized automated crawler. By means of this model, defined user tasks in the Smart TV app can be evaluated automatically in terms of their feasibility and estimated user effort, which reflects the usability of the analyzed app. This analysis can be applied in the context of regular users and users with various specific needs. The findings from this model-based automated analysis approach can be used to optimize the user interface of a Smart TV app to increase its usability, accessibility, and quality.
|
|
| 3. |
- Ahmed, Bestoun S., 1982-, et al.
(författare)
-
An Automated Testing Framework For Smart TVapps Based on Model Separation
- 2020
-
Ingår i: IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). - : IEEE Computer Society. ; , s. 62-73
-
Konferensbidrag (refereegranskat)abstract
- Smart TV application (app) is a new technological software app that can deal with smart TV devices to add more functionality and features. Despite its importance nowadays, far too little attention has been paid to present a systematic approach to test this kind of app so far. In this paper, we present a systematic model-based testing approach for smart TV app. We used our new notion of model separation to use sub-models based on the user preference instead of the exhaustive testing to generate the test cases. Based on the constructed model, we generated a set of test cases to assess the selected paths to the chosen destination in the app. We also defined new mutation operators for smart TV app to assess our testing approach. The evaluation results showed that our approach can generate more comprehensive models of smart TV apps with less time as compared to manual exploratory testing. The results also showed that our approach can generate effective test cases in term of fault detection.
|
|
| 4. |
- Ahmed, Bestoun S., 1982-, et al.
(författare)
-
Aspects of Quality in Internet of Things (IoT) Solutions : A Systematic Mapping Study
- 2019
-
Ingår i: IEEE Access. - : IEEE. - 2169-3536. ; 7, s. 13758-13780
-
Tidskriftsartikel (refereegranskat)abstract
- Internet of Things (IoT) is an emerging technology that has the promising power to change our future. Due to the market pressure, IoT systems may be released without sufficient testing. However, it is no longer acceptable to release IoT systems to the market without assuring the quality. As in the case of new technologies, the quality assurance process is a challenging task. This paper shows the results of the first comprehensive and systematic mapping study to structure and categories the research evidence in the literature starting in 2009 when the early publication of IoT papers for IoT quality assurance appeared. The conducted research is based on the most recent guidelines on how to perform systematic mapping studies. A set of research questions is defined carefully regarding the quality aspects of the IoT. Based on these questions, a large number of evidence and research papers is considered in the study (478 papers). We have extracted and analyzed different levels of information from those considered papers. Also, we have classified the topics addressed in those papers into categories based on the quality aspects. The study results carry out different areas that require more work and investigation in the context of IoT quality assurance. The results of the study can help in a further understanding of the research gaps. Moreover, the results show a roadmap for future research directions.
|
|
| 5. |
- Ahmed, Bestoun S., 1982-, et al.
(författare)
-
Code-Aware Combinatorial Interaction Testing
- 2019
-
Ingår i: IET Software. - London, England : Institution of Engineering and Technology. - 1751-8806 .- 1751-8814. ; 13:6, s. 600-609
-
Tidskriftsartikel (refereegranskat)abstract
- Combinatorial interaction testing (CIT) is a useful testing technique to address the interaction of input parameters in software systems. In many applications, the technique has been used as a systematic sampling technique to sample the enormous possibilities of test cases. In the last decade, most of the research activities focused on the generation of CIT test suites as it is a computationally complex problem. Although promising, less effort has been paid for the application of CIT. In general, to apply the CIT, practitioners must identify the input parameters for the Software-under-test (SUT), feed these parameters to the CIT tool to generate the test suite, and then run those tests on the application with some pass and fail criteria for verification. Using this approach, CIT is used as a black-box testing technique without knowing the effect of the internal code. Although useful, practically, not all the parameters having the same impact on the SUT. This paper introduces a different approach to use the CIT as a gray-box testing technique by considering the internal code structure of the SUT to know the impact of each input parameter and thus use this impact in the test generation stage. We applied our approach to five reliable case studies. The results showed that this approach would help to detect new faults as compared to the equal impact parameter approach.
|
|
| 6. |
- Ahmed, Bestoun S., 1982-, et al.
(författare)
-
Constrained interaction testing : A systematic literature study
- 2017
-
Ingår i: IEEE Access. - Sweden : IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC. - 2169-3536. ; 5, s. 25706-25730
-
Tidskriftsartikel (refereegranskat)abstract
- Interaction testing can be used to effectively detect faults that are otherwise difficult to find by other testing techniques. However, in practice, the input configurations of software systems are subjected to constraints, especially in the case of highly configurable systems. Handling constraints effectively and efficiently in combinatorial interaction testing is a challenging problem. Nevertheless, researchers have attacked this challenge through different techniques, and much progress has been achieved in the past decade. Thus, it is useful to reflect on the current achievements and shortcomings and to identify potential areas of improvements. This paper presents the first comprehensive and systematic literature study to structure and categorize the research contributions for constrained interaction testing. Following the guidelines of conducting a literature study, the relevant data are extracted from a set of 103 research papers belonging to constrained interaction testing. The topics addressed in constrained interaction testing research are classified into four categories of constraint test generation, application, generation and application, and model validation studies. The papers within each of these categories are extensively reviewed. Apart from answering several other research questions, this paper also discusses the applications of constrained interaction testing in several domains, such as software product lines, fault detection and characterization, test selection, security, and graphical user interface testing. This paper ends with a discussion of limitations, challenges, and future work in the area.
|
|
| 7. |
- Ahmed, Bestoun S., 1982-, et al.
(författare)
-
EvoCreeper: Automated Black-Box Model Generation for Smart TV Applications
- 2019
-
Ingår i: IEEE transactions on consumer electronics. - 0098-3063 .- 1558-4127. ; 65:2, s. 160-169
-
Tidskriftsartikel (refereegranskat)abstract
- Abstract—Smart TVs are coming to dominate the televisionmarket. This accompanied by an increase in the use of the smartTV applications (apps). Due to the increasing demand, developersneed modeling techniques to analyze these apps and assess theircomprehensiveness, completeness, and quality. In this paper, wepresent an automated strategy for generating models of smartTV apps based on a black-box reverse engineering. The strategycan be used to cumulatively construct a model for a given app byexploring the user interface in a manner consistent with the use ofa remote control device and extracting the runtime information.The strategy is based on capturing the states of the user interfaceto create a model during runtime without any knowledge ofthe internal structure of the app. We have implemented ourstrategy in a tool called EvoCreeper. The evaluation results showthat our strategy can automatically generate unique states anda comprehensive model that represents the real user interactionswith an app using a remote control device. The models thusgenerated can be used to assess the quality and completeness ofsmart TV apps in various contexts, such as the control of otherconsumer electronics in smart houses.
|
|
| 8. |
- Ahmed, Bestoun S., 1982-, et al.
(författare)
-
Towards an Automated Unified Framework to Run Applications for Combinatorial Interaction Testing
- 2019
-
Ingår i: EASE '19 Proceedings of the Evaluation and Assessment on Software Engineering. - NY, USA : Association for Computing Machinery (ACM). - 9781450371452 ; , s. 252-258
-
Konferensbidrag (refereegranskat)abstract
- Combinatorial interaction testing (CIT) is a well-known technique,but the industrial experience is needed to determine its effectivenessin different application domains. We present a case study introducinga unified framework for generating, executing and verifyingCIT test suites, based on the open-source Avocado test framework.In addition, we present a new industrial case study to demonstratethe effectiveness of the framework. This evaluation showed thatthe new framework can generate, execute, and verify effective combinatorialinteraction test suites for detecting configuration failures(invalid configurations) in a virtualization system.
|
|
| 9. |
- Alsarhan, Qusay, et al.
(författare)
-
Software module clustering : an in-depth literature analysis
- 2022
-
Ingår i: IEEE Transactions on Software Engineering. - : IEEE. - 0098-5589 .- 1939-3520. ; 48:6, s. 1905-1928
-
Tidskriftsartikel (refereegranskat)abstract
- Software module clustering is an unsupervised learning method used to cluster software entities (e.g., classes, modules, or files) of similar features. The obtained clusters may be used to study, analyze, and understand the structure and behavior of the software entities. Implementing software module clustering with optimal results is challenging. Accordingly, researchers have addressed many aspects of software module clustering in the last decade. Thus, it is essential to present research evidence that has been published in this area. In this study, 143 research papers that examined software module clustering from well-known literature databases were extensively reviewed to extract useful data. The obtained data were then used to answer several research questions regarding state-of-the-art clustering approaches, applications of clustering in software engineering, clustering process, clustering algorithms, and evaluation methods. Several research gaps and challenges in software module clustering are discussed in this paper to provide a useful reference for researchers in this field.
|
|
| 10. |
- Bures, Miroslav, et al.
(författare)
-
Employment of multiple algorithms for optimal path-based test selection strategy
- 2019
-
Ingår i: Information and Software Technology. - : Elsevier. - 0950-5849 .- 1873-6025. ; 114, s. 21-36
-
Tidskriftsartikel (refereegranskat)abstract
- ContextExecuting various sequences of system functions in a system under test represents one of the primary techniques in software testing. The natural method for creating effective, consistent and efficient test sequences is to model the system under test and employ an algorithm to generate tests that satisfy a defined test coverage criterion. Several criteria for preferred test set properties can be defined. In addition, to optimize the test set from an economic viewpoint, the priorities of the various parts of the system model under test must be defined.ObjectiveUsing this prioritization, the test cases exercise the high-priority parts of the system under test by more path combinations than those with low priority (this prioritization can be combined with the test coverage criterion that determines how many path combinations of the individual parts of the system are tested). Evidence from the literature and our observations confirm that finding a universal algorithm that produces a test set with preferred properties for all test coverage criteria is a challenging task. Moreover, for different individual problem instances, different algorithms provide results with the best value of a preferred property. In this paper, we present a portfolio-based strategy to perform the best test selection.MethodThe proposed strategy first employs a set of current algorithms to generate test sets; then, a preferred property of each test set is assessed in terms of the selected criterion, and finally, the test set with the best value of a preferred property is chosen.ResultsThe experimental results confirm the validity and usefulness of this strategy. For individual instances of 50 system under test models, different algorithms provided results having the best preferred property value; these results varied by the required test coverage level, the size of the priority parts of the model, and the selected test set preferred property criteria.ConclusionIn addition to the used algorithms, the proposed strategy can be used to assess the optimality of different path-based testing algorithms and choose a suitable algorithm for the testing.
|
|
