| 1. |
- Maro, Salome, 1987, et al.
(författare)
-
Impact of Gamification on Trace Link Vetting: A Controlled Experiment
- 2019
-
Ingår i: International Working Conference on Requirements Engineering: Foundation for Software Quality REFSQ 2019. - Cham : Springer. - 9783030155377
-
Konferensbidrag (refereegranskat)abstract
- [Context] Automatically generated trace links must be vetted by human analysts before use. The task of vetting trace links is considered boring due to its repetitive nature and tools that are not engaging to the analyst. Therefore, a lack of developer engagement can hamper the successful implementation of a traceability strategy in an organisation. [Objective] In this study, we examine whether two gamification features, levels and badges, have a positive effect on human analysts’ engagement and ultimately on the quality of vetted trace links. [Method] We have conducted a controlled experiment with 24 participants that vetted trace link candidates and recorded their speed, correctness, enjoyment, and perceived usability of the tool. [Results] The results indicate that there was no significant difference between the speed, correctness, and perceived usability of the control and the experiment group. However, gamification features significantly increased the users’ perceived enjoyment. Levels and badges were perceived positively by the majority of the participants while some pitfalls and improvements were pointed out. [Conclusion] Our study indicates the need for further research as the results raise several questions, in particular, w.r.t. what analyst behaviour gamification incentivises, and the impact of gamification on long-term enjoyment.
|
|
| 2. |
- Bordeleau, Francis, et al.
(författare)
-
Challenges and Research Directions for Successfully Applying MBE Tools in Practice
- 2017
-
Ingår i: CEUR Workshop Proceedings. - 1613-0073.
-
Konferensbidrag (refereegranskat)abstract
- Model Based Engineering aims to improve efficiency and effectiveness of software engineering. Success in industrial practice of MBE does not only depend on the modeling languages and constructive or analytical approaches, like code generation or model checking. It is also heavily influenced by the quality and, particularly, usability of the used tools. In this position paper, we discuss challenges experienced in applying MBE in practice both from academic as well as industrial viewpoints. Based on the research challenges, we discuss future research directions to improve the chances for the success of MBE in industrial practice.
|
|
| 3. |
- Brenner, Christian, et al.
(författare)
-
ScenarioTools real-time play-out for test sequence validation in an automotive case study
- 2014
-
Ingår i: Electronic Communications of the EASST. - 1863-2122. ; 67
-
Tidskriftsartikel (refereegranskat)abstract
- In many areas, such as automotive, healthcare, or production, we find softwareintensive systems with complex real-time requirements. To efficiently ensure the quality of these systems, engineers require automated tools for the validation of the requirements throughout the development. This, however, requires that the requirements are specified in an analyzable way. We propose modeling the specification using Modal Sequence Diagrams (MSDs), which express what a system may, must, or must not do in certain situations. MSDs can be executed via the play-out algorithm to investigate the behavior emerging from the interplay of multiple scenarios; we can also test if traces of the final product satisfy all scenarios. In this paper, we present the first tool supporting the play-out of MSDs with real-time constraints. As a case study, we modeled the requirements on gear shifts in an upcoming standard on vehicle testing and use our tool to validate externally generated gear shift sequences.
|
|
| 4. |
- de Oliveira Neto, Francisco Gomes, et al.
(författare)
-
Challenges of Aligning Requirements Engineering and System Testing in Large-Scale Agile: A Multiple Case Study
- 2017
-
Ingår i: 2017 IEEE 25th International Requirements Engineering Conference Workshops (REW), 4-8 Sept. 2017, Lisbon, Portugal. - : IEEE. - 9781538634882
-
Konferensbidrag (refereegranskat)abstract
- Abstract: As agile methods become more pervasive, agile practices are applied to more large-scale systems with a scope that goes beyond pure software. The expansion of agile in these contexts provides benefits, but creates new challenges. Widespread use of agile has changed the way we must think about practices both in Requirements Engineering (RE) and in System Testing (ST). Our experience shows that many challenges in the application of large-scale agile development relate to either RE or ST, and in particular to the alignment between these areas. In this paper we present large-scale agile-related challenges from a multiple case study which relate to REST alignment. We map our challenges to an existing framework for REST alignment, and make an initial attempt to suggest agile RE practices from the literature which may alleviate these challenges. Our results show that the interviewed companies need to first adopt more agile RE practices to enhance REST alignment and then leverage agile testing. Future work will look more towards evaluating these best practices.
|
|
| 5. |
- Fagerström, Martin, 1979, et al.
(författare)
-
Verdict Machinery: On the need to automatically make sense of test results
- 2016
-
Ingår i: International Symposium on Software Testing and Analysis (ISSTA '16). - New York, NY, USA : ACM. - 9781450343909 ; , s. 225-234
-
Konferensbidrag (refereegranskat)abstract
- Along with technological developments and increasing competition there is a major incentive for companies to produce and market high quality products before their competitors. In order to conquer a bigger portion of the market share, companies have to ensure the quality of the product in a shorter time frame. To accomplish this task companies try to automate their test processes as much as possible. It is critical to investigate and understand the problems that occur during different stages of test automation processes. In this paper we report on a case study on automatic analysis of non-functional test results.We discuss challenges in the face of continuous integration and deployment and provide improvement suggestions based on interviews at a large company in Sweden. The key contributions of this work are filling the knowledge gap in research about performance regression test analysis automation and providing warning signs and a road map for the industry.
|
|
| 6. |
- Holtmann, Jörg, 1979, et al.
(författare)
-
Processes, methods, and tools in model-based engineering-A qualitative multiple-case study
- 2024
-
Ingår i: JOURNAL OF SYSTEMS AND SOFTWARE. - 0164-1212 .- 1873-1228. ; 210
-
Tidskriftsartikel (refereegranskat)abstract
- Research on model-based engineering (MBE) has occasionally touched upon the relationship between development processes and concrete MBE practices. However, the alignment of these elements has rarely been the central focus of these studies. As a result, important questions regarding the alignment of MBE and development processes, as well as the impact of development processes on the utilization and success of MBE, have remained unanswered. To address this research gap, we conducted a multiple-case study involving 14 individuals from nine different companies, conducting a total of 12 interviews. Building upon seven propositions derived from existing literature, our investigation sought to understand how MBE is aligned with the development process and explore the application of MBE in this context. Additionally, we identified challenges and needs in this area. Our findings challenge some previously reported results, such as the perceived conflicts between agile development processes and MBE. Furthermore, we unearthed previously unreported issues, like the importance of considering the perspectives of tool vendors in MBE discussions. Overall, this paper makes a significant contribution by providing a comprehensive and up-to-date perspective on how MBE is integrated into development processes, along with an examination of the social and organizational aspects inherent to these processes.
|
|
| 7. |
- Jolak, Rodi, 1985, et al.
(författare)
-
Position paper: Knowledge sharing and distances in collaborative modeling
- 2019
-
Ingår i: Proceedings - 2019 ACM/IEEE 22nd International Conference on Model Driven Engineering Languages and Systems Companion, MODELS-C 2019. ; , s. 415-416
-
Konferensbidrag (refereegranskat)abstract
- To develop systems effectively, a shared system understanding is required. Collaborative modeling is one way to capture this shared understanding. Increasingly, in large systems engineering projects different distances lead to social barriers between stakeholders. These barriers affect the quantity and quality of knowledge that is shared between stakeholders, thus reducing the quality of the resulting product. While it has been proposed to limit modeling activities to co-located teams, this might not always be possible or feasible. We argue that, despite the technological advances in collaborative modeling, effective collaboration can only be achieved if we understand how to account for social barriers. We propose to study, in depth, how these barriers affect modeling, and how their effects can be reduced. By understanding the effects of social barriers and accounting for them, we can maximize the benefits of collaborative modeling. © 2019 IEEE
|
|
| 8. |
- Karg, Stefan, et al.
(författare)
-
Model-Driven Software Engineering in the open ETCS Project: Project Experiences and Lessons Learned
- 2016
-
Ingår i: Proceedings of 19th International Conference on Model-Driven Engineering Languages and Systems. - New York, NY, USA : ACM. ; , s. 238-248
-
Konferensbidrag (refereegranskat)abstract
- Model-driven software engineering in industrial practice has been the focus of different empirical studies and experience reports. Particularly, positive effects of model-driven software engineering have been reported in the domain of embedded and safety-critical systems. We report in this paper on the experiences of the openETCS European research project whose goal was to formalize the System Requirements Specification and to develop an open source reference implementation of the European Train Control System including open source modeling tools. Furthermore, we will discuss lessons learned, e.g., about using open source modeling toolchains in safety-critical contexts and about using the SCADE Suite for the development of the safety-critical parts.
|
|
| 9. |
|
|
| 10. |
- Kasauli, Rashida, 1984, et al.
(författare)
-
Requirements engineering challenges and practices in large-scale agile system development
- 2021
-
Ingår i: Journal of Systems and Software. - : Elsevier BV. - 0164-1212. ; 172
-
Tidskriftsartikel (refereegranskat)abstract
- Context: Agile methods have become mainstream even in large-scale systems engineering companies that need to accommodate different development cycles of hardware and software. For such companies, requirements engineering is an essential activity that involves upfront and detailed analysis which can be at odds with agile development methods. Objective: This paper presents a multiple case study with seven large-scale systems companies, reporting their challenges, together with best practices from industry. We also analyze literature about two popular large-scale agile frameworks, SAFe (R) and LeSS, to derive potential solutions for the challenges. Methods: Our results are based on 20 qualitative interviews, five focus groups, and eight cross company workshops which we used to both collect and validate our results. Results: We found 24 challenges which we grouped in six themes, then mapped to solutions from SAFe (R), LeSS, and our companies, when available. Conclusion: In this way, we contribute a comprehensive overview of RE challenges in relation to largescale agile system development, evaluate the degree to which they have been addressed, and outline research gaps. We expect these results to be useful for practitioners who are responsible for designing processes, methods, or tools for large scale agile development as well as guidance for researchers.
|
|
