| 1. |
- Araujo, Hugo, et al.
(författare)
-
Connected Automated Driving : A Model-Based Approach to the Analysis of Basic Awareness Services
- 2020
-
Ingår i: 2020 IEEE 31st Annual International Symposium on Personal, Indoor and Mobile Radio Communications. - Piscataway : Institute of Electrical and Electronics Engineers (IEEE). - 9781728144900 ; , s. 1-7
-
Konferensbidrag (refereegranskat)abstract
- Cooperative awareness basic services are key components of several Connected Autonomous Vehicles (CAV) functions. We present a rigorous approach to the analysis of cooperative awareness basic services in a CAV setup. Our approach addresses a major challenge in the traditional analysis techniques of such services, namely, coming up with effective scenarios that can meaningfully cover their various behaviours, exercise the limits of these services and come up with a quantitative means for design-space exploration.Our approach integrates model-based testing and search-based testing to automatically generate scenarios and steer the scenario generation process towards generating inputs that can lead to the most severe hazards. Additionally we define other objectives that maximise the coverage of the model and the diversity of the generated test inputs. The result of applying our technique to the analysis of cooperative awareness services leads to automatically generated hazardous scenarios for parameters that abide by the ETSI ITS-G5 vehicular communications standard. We show that our technique can be used as an effective design-space exploration method and can be used to design adaptive protocols that can mitigate the hazards detected through our initial analysis. © 2020 by IEEE
|
|
| 2. |
- Araujo, Hugo, et al.
(författare)
-
A Process for Sound Conformance Testing of Cyber-Physical Systems
- 2017
-
Ingår i: 2017 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). - Los Alamitos, CA : IEEE Computer Society. - 9781509066766 - 9781509066773 ; , s. 46-50
-
Konferensbidrag (refereegranskat)abstract
- We present a process for sound conformance testing of cyber-physical systems, which involves functional but also non-functional aspects. The process starts with a hybrid model of cyber-physical systems in which the correct behavior of the system (at its interface level) is specified. Such a model captures both discrete behavior and evolution of continuous dynamics of the system in time. Since conformance testing inherently involves comparing continuous dynamics, the key parameters of the process are (1) the conformance bounds defining when two signals are sufficiently close to each other, and (2) the permitted error margin in the conformance analysis introduced by sampling of continuous signals. The final parameter of this process is (3) finding (and adjusting) the sampling rate of the dynamic behavior. In the specified process, we provide different alternatives for fixing the error margin of the conformance testing if the sampling rate is fixed, establishing the sampling rate if the error margin is fixed and finding conformance bounds once the sampling rate and the error margin are fixed. © 2017 IEEE.
|
|
| 3. |
- Araujo, Hugo, et al.
(författare)
-
Sound conformance testing for cyber-physical systems : Theory and implementation
- 2018
-
Ingår i: Science of Computer Programming. - Amsterdam : ELSEVIER SCIENCE BV. - 0167-6423 .- 1872-7964. ; 162, s. 35-54
-
Tidskriftsartikel (refereegranskat)abstract
- Conformance testing is a formal and structured approach to verifying system correctness. We propose a conformance testing algorithm for cyber-physical systems, based on the notion of hybrid conformance by Abbas and Fainekos. We show how the dynamics of system specification and the sampling rate play an essential role in making sound verdicts. We specify and prove error bounds that lead to sound test-suites for a given specification and a given sampling rate. We use reachability analysis to find such bounds and implement the proposed approach using the CORA toolbox in Matlab. We apply the implemented approach on a case study from the automotive domain.
|
|
| 4. |
- Enoiu, Eduard, 1986-
(författare)
-
Model Checking-Based Software Testing for Function-Block Diagrams
- 2014
-
Licentiatavhandling (övrigt vetenskapligt/konstnärligt)abstract
- Software testing becomes more complex, more time-consuming, and more expensive. The risk that software errors remain undetected and cause critical failures increases. Consequently, in safety-critical development, testing software is standardized and it requires an engineer to show that tests fully exercise, or cover, the logic of the software. This method often requires a trained engineer to perform manual test generation, is prone to human error, and is expensive or impractical to use frequently in production. To overcome these issues, software testing needs to be performed earlier in the development process, more frequently, and aided by automated tools.We devised an automated test generation tool called COMPLETETEST that avoids many of those problems. The method implemented in the tool and described in this thesis, works with software written in Function Block Diagram language, and can provide tests in just a few seconds. In addition, it does not rely on the expertise of a researcherspecialized in automated test generation and model checking. Although COMPLETETEST itself uses a model checker, a complex technique requiring a high level of expertise to generate tests, it provides a straightforward tabular interface to the intended users. In this way, its users do not need to learn the intricacies of using this approach such as how coverage criteria can be formalized and used by a model checker to automatically generate tests. If the technique can be demonstrated to work in production, it could detect and aid in the detection of errors in safety-critical software development, where conventional testing is not always applicable and efficient.We conducted studies based on industrial use-case scenarios from Bombardier Transportation AB, showing how the approach can be applied to generate tests in software systems used in the safety-critical domain. To evaluate the approach, it was applied on real-world programs. The results indicate that it is efficient in terms of time required to generate tests and scales well for most of the software. There are still issues to resolve before the technique can be applied to more complex software, but we are already working on ways to overcome them. In particular, we need to understand how its usage in practice can vary depending on human and software process factors.
|
|
| 5. |
- Entekhabi, Sina, 1989-, et al.
(författare)
-
Domain Specific Language for Testing Grid-based Multiagent Autonomous Systems
-
Annan publikation (övrigt vetenskapligt/konstnärligt)abstract
- The automatic generation of random test inputs offers a potential solution to the challenges associated with manual test case design. However, the use of random test cases may prove ineffective for fault detection and can escalate testing costs, particularly in systems where test execution demands significant resources and time. To address this issue, leveraging the domain knowledge of test engineers becomes crucial for selecting test cases with the potential for effectiveness. One approach involves utilizing test selection constraints recommended by domain experts, which can be applied to generate targeted test inputs. In our previous paper, we introduced a domain-specific language (DSL) designed to formalize locality-based test selection constraints specifically tailored for autonomous agents. In this work, we devise an extended DSL for specifying more detailed test scenarios for a more elaborate model of autonomous agents and environment. We design a questionnaire and ask several experts' opinions about the usefulness of the DSL and also design an experiment to compare the efficiency, in terms of time needed to reach a failure, of the extended DSL with the initially proposed one. The questionnaire results show that some features of the extended DSL look useful in the experts' opinion, and the experiment results show that testing with the extended DSL can considerably improve the efficiency of the testing process.
|
|
| 6. |
- Khakpour, Narges, et al.
(författare)
-
Notions of Conformance Testing for Cyber-Physical Systems : Overview and Roadmap
- 2015
-
Ingår i: 26th International Conference on Concurrency Theory. - Wadern : Dagstuhl Publishing. - 9783939897910 ; , s. 18-40
-
Konferensbidrag (populärvet., debatt m.m.)abstract
- We review and compare three notions of conformance testing for cyber-physical systems. We begin with a review of their underlying semantic models and present conformance-preserving translations between them. We identify the differences in the underlying semantic models and the various design decisions that lead to these substantially different notions of conformance testing. Learning from this exercise, we reflect upon the challenges in designing an “ideal” notion of conformance for cyber-physical systems and sketch a roadmap of future research in this domain.
|
|
| 7. |
|
|
| 8. |
- Mohaqeqi, Morteza, et al.
(författare)
-
Sound Test-Suites for Cyber-Physical Systems
- 2016
-
Ingår i: Proceedings of the 10th International Symposium on Theoretical Aspects of Software Engineering (TASE 2016). - Piscataway : IEEE Computer Society. - 9781509017645 - 9781509017652 ; , s. 42-48
-
Konferensbidrag (refereegranskat)abstract
- Conformance testing is a formal and structured approach to verifying system correctness. We propose a conformance testing algorithm for cyber-physical systems, based on the notion of hybrid conformance by Abbas and Fainekos. We show how the dynamics of system specification and the sampling rate play an essential role in making sound verdicts. We specify and prove error bounds that lead to sound test-suites for a given specification and a given sampling rate. © 2016 IEEE.
|
|
| 9. |
- Oliveira, Bruno, et al.
(författare)
-
Simulation of hybrid systems from natural-language requirements
- 2018
-
Ingår i: 2017 13th IEEE Conference on Automation Science and Engineering (CASE). - Piscataway, NJ : IEEE Computer Society. - 9781509067817 - 9781509067800 - 9781509067824 ; , s. 1320-1325
-
Konferensbidrag (refereegranskat)abstract
- Cyber-physical systems are characterised by a massive and tight interaction between computer systems and physical components. Hybrid systems provide an abstraction for modelling cyber-physical systems by featuring the integration of discrete and continuous behavioural aspects. Simulation is an important tool for validating hybrid system models, which are often too complex to be treated using other validation and verification techniques. Motivated by the industrial need for such tools, we propose a strategy (h-NAT2TEST) for simulation of hybrid systems from natural-language requirements. Using the proposed approach, one writes the system specification using a controlled natural language, from which an informal semantics is automatically inferred based on the case grammar theory. Then, a formal representation is built considering a model of hybrid data-flow reactive systems (h-DFRS). Finally, in order to allow for rigorous simulation, an Acumen specification is derived from the h-DFRS model. Simulation is supported by the Acumen modelling environment. A DC-DC boost converter is used as a case study to illustrate the overall approach. © 2017 IEEE.
|
|
| 10. |
- Varshosaz, Mahsa, 1985-, et al.
(författare)
-
A classification of product sampling for software product lines
- 2018
-
Ingår i: SPLC '18 Proceedings of the 22nd International Systems and Software Product Line Conference - Volume 1. - New York, NY : Association for Computing Machinery (ACM). - 9781450363716 - 9781450364645 ; , s. 1-13
-
Konferensbidrag (refereegranskat)abstract
- The analysis of software product lines is challenging due to the potentially large number of products, which grow exponentially in terms of the number of features. Product sampling is a technique used to avoid exhaustive testing, which is often infeasible. In this paper, we propose a classification for product sampling techniques and classify the existing literature accordingly. We distinguish the important characteristics of such approaches based on the information used for sampling, the kind of algorithm, and the achieved coverage criteria. Furthermore, we give an overview on existing tools and evaluations of product sampling techniques. We share our insights on the state-of-the-art of product sampling and discuss potential future work. © 2018 Association for Computing Machinery.
|
|
