| 1. |
- Berntsson Svensson, Richard, 1978, et al.
(författare)
-
The unfulfilled potential of data-driven decision making in agile software development
- 2019
-
Ingår i: Lecture Notes in Business Information Processing. - Cham : Springer International Publishing. - 1865-1356 .- 1865-1348. - 9783030190330 ; 355, s. 69-85
-
Konferensbidrag (refereegranskat)abstract
- With the general trend towards data-driven decision making (DDDM), organizations are looking for ways to use DDDM to improve their decisions. However, few studies have looked into the practitioners view of DDDM, in particular for agile organizations. In this paper we investigated the experiences of using DDDM, and how data can improve decision making. An emailed questionnaire was sent out to 124 industry practitioners in agile software developing companies, of which 84 answered. The results show that few practitioners indicated a wide-spread use of DDDM in their current decision making practices. The practitioners were more positive to its future use for higher-level and more general decision making, fairly positive to its use for requirements elicitation and prioritization decisions, while being less positive to its future use at the team level. The practitioners do see a lot of potential for DDDM in an agile context; however, currently unfulfilled.
|
|
| 2. |
- Afzal, Wasif, et al.
(författare)
-
Software Test Process Improvement Approaches: A Systematic Literature Review and an Industrial Case Study
- 2016
-
Ingår i: Journal of Systems and Software. - : Elsevier BV. - 0164-1212. ; 111, s. 1-33
-
Tidskriftsartikel (refereegranskat)abstract
- Software Test Process Improvement (STPI) approaches are frameworks that guide software development organizations to improve their software testing process. We have identified existing STPI approaches and their characteristics (such as completeness of development, availability of information and assessment instruments, and domain limitations of the approaches) using a systematic literature review (SLR). Furthermore, two selected approaches (TPI Next and TMMi) are evaluated with respect to their content and assessment results in industry. As a result of this study, we have identified 18 STPI approaches and their characteristics. A detailed comparison of the content of TPI Next and TMMi is done. We found that many of the STPI approaches do not provide sufficient information or the approaches do not include assessment instruments. This makes it difficult to apply many approaches in industry. Greater similarities were found between TPI Next and TMMi and fewer differences. We conclude that numerous STPI approaches are available but not all are generally applicable for industry. One major difference between available approaches is their model representation. Even though the applied approaches generally show strong similarities, differences in the assessment results arise due to their different model representations.
|
|
| 3. |
- Afzal, Wasif, et al.
(författare)
-
Towards benchmarking feature subset selection methods for software fault prediction
- 2016
-
Ingår i: Computational Intelligence and Quantitative Software Engineering. - Berlin, Heidelberg : Springer. - 9783319259642 - 9783319259628 ; , s. 33-58
-
Bokkapitel (refereegranskat)abstract
- Despite the general acceptance that software engineering datasets often contain noisy, irrele- vant or redundant variables, very few benchmark studies of feature subset selection (FSS) methods on real-life data from software projects have been conducted. This paper provides an empirical comparison of state-of-the-art FSS methods: information gain attribute ranking (IG); Relief (RLF); principal com- ponent analysis (PCA); correlation-based feature selection (CFS); consistency-based subset evaluation (CNS); wrapper subset evaluation (WRP); and an evolutionary computation method, genetic programming (GP), on five fault prediction datasets from the PROMISE data repository. For all the datasets, the area under the receiver operating characteristic curve—the AUC value averaged over 10-fold cross- validation runs—was calculated for each FSS method-dataset combination before and after FSS. Two diverse learning algorithms, C4.5 and na ̈ıve Bayes (NB) are used to test the attribute sets given by each FSS method. The results show that although there are no statistically significant differences between the AUC values for the different FSS methods for both C4.5 and NB, a smaller set of FSS methods (IG, RLF, GP) consistently select fewer attributes without degrading classification accuracy. We conclude that in general, FSS is beneficial as it helps improve classification accuracy of NB and C4.5. There is no single best FSS method for all datasets but IG, RLF and GP consistently select fewer attributes without degrading classification accuracy within statistically significant boundaries.
|
|
| 4. |
- Aguayo, Claudio, et al.
(författare)
-
Contextualizando el uso de tecnologías inteligentes móviles para el monitoreo y educación de visitantes [Contextualising the use of smart mobile technologies for visitor monitoring and education]
- 2019
-
Ingår i: XI SOCIETUR [Chilean Society for Tourism Research] Conference 2019, 24-26 April, Punta Arenas, Chile: SOCIETUR. - Santiago : XI SOCIETUR [Chilean Society for Tourism Research].
-
Konferensbidrag (refereegranskat)abstract
- Con una expansión de la recreación al aire libre y el desarrollo del turismo en muchos países hoy en día, el monitoreo de visitantes y la educación pueden considerarse como dos partes integrales de la gestión recreativa contemporánea. El monitoreo de visitantes se refiere a la documentación profesional de actividades recreativas y comportamiento en contextos de áreas recreativas. Esto se ha convertido en una tarea de gestión cada vez más importante para garantizar que los intereses y las experiencias recreativas de los visitantes se incluyan en diversas políticas y estrategias de gestión (Hansen, 2016). La educación de los visitantes, por otro lado, se refiere a cómo las áreas recreativas pueden ofrecer importantes oportunidades de aprendizaje experiencial para la educación relevante basada en el contexto local. La educación dirigida a los visitantes puede complementar y reforzar las experiencias al aire libre, pudiendo ser una forma importante de promover objetivos de sostenibilidad, como la adaptación local al cambio climático (Lück, 2015). Las estrategias de monitoreo y educación de los visitantes se han establecido y utilizado durante mucho tiempo en la gestión de diferentes contextos recreativos en todo el mundo. Sin embargo, el uso de nuevas tecnologías inteligentes para propósitos de monitoreo y educación ha recibido poca atención. Actualmente hay muy poca información disponible sobre el uso potencial de la tecnología móvil, como teléfonos inteligentes y tablets, para fines de monitoreo y educación dentro de contextos de áreas recreativas. La tecnología móvil puede ofrecer muchas opciones novedosas para actividades de monitoreo pasivo y activo de visitantes (Ahas et al., 2010). Del mismo modo, las tecnologías de aprendizaje móvil de hoy en día ofrecen herramientas y posibilidades sin precedentes para complementar y reforzar las experiencias de aprendizaje recreativo al aire libre. Además, éste proceso puede conllevar y una adaptación del aprendizaje a las temáticas relevantes a nivel local, incluyendo elementos culturalmente significativo (Aguayo, 2016). Sin embargo, este tipo de aplicación de las tecnologías móviles inteligentes sigue siendo un área poco explorada de investigación y desarrollo, sobre todo en el área de gestión turística. Desde este proyecto en curso, se propone un marco teórico conceptual inicial para el uso de tecnologías móviles inteligentes para el monitoreo y educación de visitantes en contextos recreacionales. Éste marco se ha desarrollado originalmente a partir de los contextos de turismo de mar costero en Suecia y Nueva Zelanda, encontrándose aún en etapa de conceptualización. En esta sesión se presentará el proyecto, incluyendo indicadores tempranos propuestos por actores en gobernanza y gestión de destinos turísticos de Suecia y Nueva Zelanda que han definido el marco teórico; y en segunda parte se llevará a cabo una breve sesión interactiva de lluvia de ideas para recoger las ideas y propuestas que surjan desde la audiencia en torno a la aplicación del marco teórico en el contexto de la Patagonia y otros destinos, según los presentes.
|
|
| 5. |
|
|
| 6. |
- Darwish, Rashid, 1980, et al.
(författare)
-
A Controlled Experiment on Coverage Maximization of Automated Model-Based Software Test Cases in the Automotive Industry
- 2017
-
Ingår i: Proceedings - 10th IEEE International Conference on Software Testing, Verification and Validation, ICST 2017. ; , s. 546-547
-
Konferensbidrag (refereegranskat)abstract
- © 2017 IEEE. In the automotive industry, as the complexity of electronic control units (ECUs) increase, there is a need for the creation of models that facilitate early tests to ensure functionality, but there is little guidance on how to write these tests in order to achieve maximum coverage. Our prototype CANoe+, which builds on the CANoe and GraphWalker tools, was evaluated against CANoe with regard to coverage maximization of generated test cases from the viewpoint of both software developers and software testers.
|
|
| 7. |
- de Oliveira Neto, Francisco Gomes, et al.
(författare)
-
Full modification coverage through automatic similarity-based test case selection
- 2016
-
Ingår i: Information and Software Technology. - : Elsevier BV. - 0950-5849. ; 80, s. 124-137
-
Tidskriftsartikel (refereegranskat)abstract
- Context: This paper presents the similarity approach for regression testing (SART), where a similarity-based test case selection technique is used in a model-based testing process to provide selection of test cases exercising modified parts of a specification model. Unlike other model-based regression testing techniques, SART relies on similarity analysis among test cases to identify modifications, instead of comparing models, hence reducing the dependency on specific types of model. Objective: To present convincing evidence of the usage of similarity measures for modification-traversing test case selection. Method: We investigate SART in a case study and an experiment. The case study uses artifacts from industry and should be seen as a sanity check of SART, while the experiment focuses on gaining statistical power through the generation of synthetical models in order to provide convincing evidence of SART’s effectiveness. Through posthoc analysis we obtain p-values and effect sizes to observe statistically significant differences between treatments with respect to transition and modification coverage. Results: The case study with industrial artifacts revealed that SART is able to uncover the same number of defects as known similarity-based test case selection techniques. In turn, the experiment shows that SART, unlike the other investigated techniques, presents 100% modification coverage. In addition, all techniques covered a similar percentage of model transitions. Conclusions: In summary, not only does SART provide transition and defect coverage equal to known STCS techniques, but it exceeds greatly in covering modified parts of the specification model, being a suitable candidate for model-based regression testing. Keywords: Regression testing, Test case selection, Model-based testing, Experimental Study
|
|
| 8. |
- Dobslaw, Felix, 1983, et al.
(författare)
-
Estimating Return on Investment for GUI Test Automation Frameworks
- 2019
-
Ingår i: Proceedings - International Symposium on Software Reliability Engineering, ISSRE. - 1071-9458. - 9781728149813 ; 2019-October
-
Konferensbidrag (refereegranskat)abstract
- Automated graphical user interface (GUI) tests can reduce manual testing activities and increase test frequency. This motivates the conversion of manual test cases into automated GUI tests. However, it is not clear whether such automation is cost-effective given that GUI automation scripts add to the code base and demand maintenance as a system evolves. In this paper, we introduce a method for estimating maintenance cost and Return on Investment (ROI) for Automated GUI Testing (AGT). The method utilizes the existing source code change history and has the potential to be used for the evaluation of other testing or quality assurance automation technologies. We evaluate the method for a real-world, industrial software system and compare two fundamentally different AGT frameworks, namely Selenium and EyeAutomate, to estimate and compare their ROI. We also report on their defect-finding capabilities and usability. The quantitative data is complemented by interviews with employees at the company the study has been conducted at. The method was successfully applied, and estimated maintenance cost and ROI for both frameworks are reported. Overall, the study supports earlier results showing that implementation time is the leading cost for introducing AGT. The findings further suggest that, while EyeAutomate tests are significantly faster to implement, Selenium tests require more of a programming background but less maintenance.
|
|
| 9. |
- Dobslaw, F., et al.
(författare)
-
Estimating Return on Investment for GUI Test Automation Frameworks
- 2019
-
Ingår i: 2019 IEEE 30th International Symposium on Software Reliability Engineering (ISSRE). - : IEEE. - 9781728149820
-
Konferensbidrag (refereegranskat)abstract
- Automated graphical user interface (GUI) tests can reduce manual testing activities and increase test frequency. This motivates the conversion of manual test cases into automated GUI tests. However, it is not clear whether such automation is cost-effective given that GUI automation scripts add to the code base and demand maintenance as a system evolves. In this paper, we introduce a method for estimating maintenance cost and Return on Investment (ROI) for Automated GUI Testing (AGT). The method utilizes the existing source code change history and has the potential to be used for the evaluation of other testing or quality assurance automation technologies. We evaluate the method for a real-world, industrial software system and compare two fundamentally different AGT frameworks, namely Selenium and EyeAutomate, to estimate and compare their ROI. We also report on their defect-finding capabilities and usability. The quantitative data is complemented by interviews with employees at the company the study has been conducted at. The method was successfully applied, and estimated maintenance cost and ROI for both frameworks are reported. Overall, the study supports earlier results showing that implementation time is the leading cost for introducing AGT. The findings further suggest that, while EyeAutomate tests are significantly faster to implement, Selenium tests require more of a programming background but less maintenance.
|
|
| 10. |
|
|
| 11. |
- Felderer, Michael, 1978-, et al.
(författare)
-
A testability analysis framework for non-functional properties
- 2018
-
Ingår i: 2018 IEEE 11TH INTERNATIONAL CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION WORKSHOPS (ICSTW). - : Institute of Electrical and Electronics Engineers Inc.. - 9781538663523 ; , s. 54-58
-
Konferensbidrag (refereegranskat)abstract
- This paper presents background, the basic steps and an example for a testability analysis framework for non-functional properties.
|
|
| 12. |
- Feldt, Robert, 1972, et al.
(författare)
-
Ways of applying artificial intelligence in software engineering
- 2018
-
Ingår i: Proceedings - International Conference on Software Engineering. - New York : IEEE. - 0270-5257. ; Part F137725, s. 35-41
-
Konferensbidrag (refereegranskat)abstract
- As Artificial Intelligence (AI) techniques become more powerful and easier to use they are increasingly deployed as key components of modern software systems. While this enables new functionality and often allows better adaptation to user needs it also creates additional problems for software engineers and exposes companies to new risks. Some work has been done to better understand the interaction between Software Engineering and AI but we lack methods to classify ways of applying AI in software systems and to analyse and understand the risks this poses. Only by doing so can we devise tools and solutions to help mitigate them. This paper presents the AI in SE Application Levels (AI-SEAL) taxonomy that categorises applications according to their point of application, the type of AI technology used and the automation level allowed. We show the usefulness of this taxonomy by classifying 15 papers from previous editions of the RAISE workshop. Results show that the taxonomy allows classification of distinct AI applications and provides insights concerning the risks associated with them. We argue that this will be important for companies in deciding how to apply AI in their software applications and to create strategies for its use.
|
|
| 13. |
- Gomes, Francisco, 1987, et al.
(författare)
-
Evolution of statistical analysis in empirical software engineering research : Current state and steps forward
- 2019
-
Ingår i: Journal of Systems and Software. - : Elsevier Inc.. - 0164-1212 .- 1873-1228. ; 156, s. 246-267
-
Tidskriftsartikel (refereegranskat)abstract
- Software engineering research is evolving and papers are increasingly based on empirical data from a multitude of sources, using statistical tests to determine if and to what degree empirical evidence supports their hypotheses. To investigate the practices and trends of statistical analysis in empirical software engineering (ESE), this paper presents a review of a large pool of papers from top-ranked software engineering journals. First, we manually reviewed 161 papers and in the second phase of our method, we conducted a more extensive semi-automatic classification of papers spanning the years 2001–2015 and 5196 papers. Results from both review steps was used to: i) identify and analyse the predominant practices in ESE (e.g., using t-test or ANOVA), as well as relevant trends in usage of specific statistical methods (e.g., nonparametric tests and effect size measures) and, ii) develop a conceptual model for a statistical analysis workflow with suggestions on how to apply different statistical methods as well as guidelines to avoid pitfalls. Lastly, we confirm existing claims that current ESE practices lack a standard to report practical significance of results. We illustrate how practical significance can be discussed in terms of both the statistical analysis and in the practitioner's context. © 2019 Elsevier Inc.
|
|
| 14. |
- Gren, Lucas, 1984, et al.
(författare)
-
Group development and group maturity when building agile teams: A qualitative and quantitative investigation at eight large companies
- 2017
-
Ingår i: Journal of Systems and Software. - : Elsevier BV. - 0164-1212 .- 1873-1228. ; 124, s. 104-119
-
Tidskriftsartikel (refereegranskat)abstract
- The agile approach to projects focuses more on close-knit teams than traditional waterfall projects, which means that aspects of group maturity become even more important. This psychological aspect is not much researched in connection to the building of an "agile team." The purpose of this study is to investigate how building agile teams is connected to a group development model taken from social psychology. We conducted ten semi-structured interviews with coaches, Scrum Masters, and managers responsible for the agile process from seven different companies, and collected survey data from 66 group-members from four companies (a total of eight different companies). The survey included an agile measurement tool and the one part of the Group Development Questionnaire. The results show that the practitioners define group developmental aspects as key factors to a successful agile transition. Also, the quantitative measurement of agility was significantly correlated to the group maturity measurement. We conclude that adding these psychological aspects to the description of the "agile team" could increase the understanding of agility and partly help define an "agile team." We propose that future work should develop specific guidelines for how software development teams at different maturity levels might adopt agile principles and practices differently. (C) 2016 Elsevier Inc. All rights reserved.
|
|
| 15. |
- Gren, Lucas, 1984, et al.
(författare)
-
Group Maturity and Agility, Are They Connected? - A Survey Study
- 2015
-
Ingår i: EUROMICRO Conference on Software Engineering and Advanced Applications (SEAA 2015), August 26-28. - : IEEE. - 9781467375856
-
Konferensbidrag (refereegranskat)abstract
- The focus on psychology has increased within software engineering due to the project management innovation "agile development processes". The agile methods do not explicitly consider group development aspects, they simply assume what is described in group psychology as mature groups. This study was conducted with 45 employees and their twelve managers (N=57) from two SAP customers in the US that were working with agile methods, and the data were collected via an online survey. The selected Agility measurement was correlated to a Group Development measurement and showed significant convergent validity, i.e., A more mature team is also a more agile team. This means that the agile methods probably would benefit from taking group development into account when its practices are being introduced.
|
|
| 16. |
- Gren, Lucas, 1984, et al.
(författare)
-
The Prospects of a Quantitative Measurement of Agility: A Validation Study on an Agile Maturity Model
- 2015
-
Ingår i: Journal of Systems and Software. - : Elsevier BV. - 0164-1212 .- 1873-1228. ; 107, s. 38-49
-
Tidskriftsartikel (refereegranskat)abstract
- Agile development has now become a well-known approach to collaboration in professional work life. Both researchers and practitioners want validated tools to measure agility. This study sets out to validate an agile maturity measurement model with statistical tests and empirical data. First, a pretest was conducted as a case study including a survey and focus group. Second, the main study was conducted with 45 employees from two SAP customers in the US. We used internal consistency (by a Cronbach’s alpha) as the main measure for reliability and analyzed construct validity by exploratory principal factor analysis (PFA). The results suggest a new categorization of a subset of items existing in the tool and provides empirical support for these new groups of factors. However, we argue that more work is needed to reach the point where a maturity models with quantitative data can be said to validly measure agility, and even then, such a measurement still needs to include some deeper analysis with cultural and contextual items.
|
|
| 17. |
- Marculescu, Bogdan, et al.
(författare)
-
Tester interactivity makes a difference in search-based software testing : A controlled experiment
- 2016
-
Ingår i: Information and Software Technology. - : Elsevier. - 0950-5849 .- 1873-6025. ; 78, s. 66-82
-
Tidskriftsartikel (refereegranskat)abstract
- Context: Search-based software testing promises to provide users with the ability to generate high quality test cases, and hence increase product quality, with a minimal increase in the time and effort required. The development of the Interactive Search-Based Software Testing (ISBST) system was motivated by a previous study to investigate the application of search-based software testing (SBST) in an industrial setting. ISBST allows users to interact with the underlying SBST system, guiding the search and assessing the results. An industrial evaluation indicated that the ISBST system could find test cases that are not created by testers employing manual techniques. The validity of the evaluation was threatened, however, by the low number of participants. Objective: This paper presents a follow-up study, to provide a more rigorous evaluation of the ISBST system. Method: To assess the ISBST system a two-way crossover controlled experiment was conducted with 58 students taking a Verification and Validation course. The NASA Task Load Index (NASA-TLX) is used to assess the workload experienced by the participants in the experiment. Results:The experimental results validated the hypothesis that the ISBST system generates test cases that are not found by the same participants employing manual testing techniques. A follow-up laboratory experiment also investigates the importance of interaction in obtaining the results. In addition to this main result, the subjective workload was assessed for each participant by means of the NASA-TLX tool. The evaluation showed that, while the ISBST system required more effort from the participants, they achieved the same performance. Conclusions: The paper provides evidence that the ISBST system develops test cases that are not found by manual techniques, and that interaction plays an important role in achieving that result. (C) 2016 Elsevier B.V. All rights reserved.
|
|
| 18. |
- Marculescu, Bogdan, 1984, et al.
(författare)
-
Transferring interactive search-based software testing to industry
- 2018
-
Ingår i: Journal of Systems and Software. - : Elsevier BV. - 0164-1212 .- 1873-1228. ; 142, s. 156-170
-
Tidskriftsartikel (refereegranskat)abstract
- Context: Search-Based Software Testing (SBST), and the wider area of Search-Based Software Engineering (SBSE), is the application of optimization algorithms to problems in software testing, and software engineering, respectively. New algorithms, methods, and tools are being developed and validated on benchmark problems. In previous work, we have also implemented and evaluated Interactive Search-Based Software Testing (ISBST) tool prototypes, with a goal to successfully transfer the technique to industry. Objective: While SBST and SBSE solutions are often validated on benchmark problems, there is a need to validate them in an operational setting, and to assess their performance in practice. The present paper discusses the development and deployment of SBST tools for use in industry, and reflects on the transfer of these techniques to industry. Method: In addition to previous work discussing the development and validation of an ISBST prototype, a new version of the prototype ISBST system was evaluated in the laboratory and in industry. This evaluation is based on an industrial System under Test (SUT) and was carried out with industrial practitioners. The Technology Transfer Model is used as a framework to describe the progression of the development and evaluation of the ISBST system, as it progresses through the first five of its seven steps. Results: The paper presents a synthesis of previous work developing and evaluating the ISBST prototype, as well as presenting an evaluation, in both academia and industry, of that prototype's latest version. In addition to the evaluation, the paper also discusses the lessons learned from this transfer. Conclusions: This paper presents an overview of the development and deployment of the ISBST system in an industrial setting, using the framework of the Technology Transfer Model. We conclude that the ISBST system is capable of evolving useful test cases for that setting, though improvements in the means the system uses to communicate that information to the user are still required. In addition, a set of lessons learned from the project are listed and discussed. Our objective is to help other researchers that wish to validate search-based systems in industry, and provide more information about the benefits and drawbacks of these systems.
|
|
| 19. |
- Marculescu, Bogdan, 1984, et al.
(författare)
-
Using exploration focused techniques to augment search-based software testing: an experimental evaluation
- 2016
-
Ingår i: 2016 IEEE International Conference on Software Testing, Verification and Validation (ICST). - : IEEE. - 2381-2834. - 9781509018277 - 9780306406157 ; , s. 69-79
-
Konferensbidrag (refereegranskat)abstract
- Search-based software testing (SBST)often uses objective-based approaches to solve testing problems. There are, however, situations where the validity and completeness of objectives cannot be ascertained, or where there is insufficient information to define objectives at all. Incomplete or incorrect objectives may steer the search away from interesting behavior of the software under test (SUT) and from potentially useful test cases.This papers investigates the degree to whichexploration-based algorithms can be used tocomplement an objective-based tool we have previously developed and evaluated in industry. In particular, we would like to assess how exploration-based algorithms perform in situations where little information on the behavior space is available a priori. We have conducted an experiment comparing the performance of an exploration-based algorithm with an objective-based one on a problem with a high dimensional behavior space. In addition, we evaluate to what extent that performance degrades in situations where computational resources are limited.Our experiment shows that exploration-basedalgorithms are useful in covering a larger area of the behavior space and result in a more diverse solution population. Typically, of the candidate solutions that exploration-based algorithms propose, more than 80% were not covered by their objective-based counterpart. This increased diversity is present in the resulting population even when computational resources are limited. We conclude that exploration-focused algorithms are a useful means of investigating high-dimensional spaces, even in situations where limited information and limited resources are available.
|
|
| 20. |
- Mellblom, Emanuel, et al.
(författare)
-
The Connection between Burnout and Personality Types in Software Developers
- 2019
-
Ingår i: IEEE Software. - 1937-4194 .- 0740-7459. ; 36:5, s. 57-64
-
Tidskriftsartikel (refereegranskat)abstract
- This article examines the connection between the five-factor model personality traits and burnout in software developers and aims to validate generalizations of findings in other fields.
|
|
| 21. |
- Neto, F. G. D., et al.
(författare)
-
An Initiative to Improve Reproducibility and Empirical Evaluation of Software Testing Techniques
- 2015
-
Ingår i: 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering, Vol 2. - : IEEE. - 9781479919345
-
Konferensbidrag (refereegranskat)abstract
- The current concern regarding quality of evaluation performed in existing studies reveals the need for methods and tools to assist in the definition and execution of empirical studies and experiments. However, when trying to apply general methods from empirical software engineering in specific fields, such as evaluation of software testing techniques, new obstacles and threats to validity appears, hindering researchers' use of empirical methods. This paper discusses those issues specific for evaluation of software testing techniques and proposes an initiative for a collaborative effort to encourage reproducibility of experiments evaluating software testing techniques (STT). We also propose the development of a tool that enables automatic execution and analysis of experiments producing a reproducible research compendia as output that is, in turn, shared among researchers. There are many expected benefits from this endeavour, such as providing a foundation for evaluation of existing and upcoming STT, and allowing researchers to devise and publish better experiments.
|
|
| 22. |
- Pirzadeh Irannezhad, Laleh, 1985, et al.
(författare)
-
Systematic Literature Review on risk management in agile and plan driven software development
- 2016
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- Context: Software development is a process prone to high level of risk due to issues in development phases, management strategy and the environment where it is performed. Agile development approaches are assumed to have less risk resolution in comparison with traditional approaches. Although, this is well accepted in industry and academia, to the best of our knowledge, there have not been any studies investigating this difference. Objectives: The main objective of this paper is to investigate whether risk resolution is affected by the choice of development process. Further, we investigated application domains, research methods, types of risk (i.e. perceived risk as perception of risk by practitioners, or actual risk as risk compiled from project historical data), software development and project management phases, and development models reported on in the papers included in this study.Methods: A Systematic Literature Review (SLR) was conducted in the fields of software engineering, project management and risk management. Using a set of rigorous inclusion and exclusion criteria 78 primary studies were selected. From this information relevant to our research questions was collected. Results: No publications were found that report a difference in risk resolution between agile and traditional development approaches. The most common application domains are defense, financial sector and Information Systems industry each addressed by three primary studies and the most applied research method is design of models (49 publications). Perceived risk is the most popular type of risk addressed by 41 primary studies. Requirement analysis (18 publications) and planning (23 publications) are respectively the most addressed development and management phases. Lastly a combination of agile and plan driven approaches was addressed the most nine primary studies. Conclusion: The results from this SLR highlight a demand for empirical research on risk management applied in different development processes. Further, data from additional domains should be added to the body of knowledge in order to investigate generalizability of the findings. Moreover, due to lack of data, actual risk is not investigated as much as perceived risk, which highlights the demand field for quantitative studies in the research.
|
|
| 23. |
- Skriver Hansen, Andreas, 1983, et al.
(författare)
-
Visitor monitoring and education in recreation and tourism management in marine protected areas: A technology-driven approach
- 2019
-
Ingår i: Proceedings of the 13th Annual Conference of the International Competence Network of Tourism Research and Education (ICNT): The future of community engagement in tourism: Adressing the (im)balance between tourism growth and local community involvement.
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- The project proposes the development of a digital platform for visitor monitoring and education in the management of sustainable outdoor recreation and tourism. Visitor monitoring and education are important activities in modern outdoor recreation and tourism management, and have long been two central research themes among outdoor and tourism researchers, both in Sweden and internationally. The introduction of emerging technologies is important because it allows the development of more efficient visitor management and unique educational opportunities. This development, in turn, promotes more sustainable outdoor recreation and tourism activities through knowledge and education of visitors when they are engaging with nature. The aim of this project is to address the design, development and implementation of a digital platform for visitor monitoring and education, focusing on smart digital technology in the advancement of sustainable management of outdoor recreation and tourism. The project will draw attention to several research and development opportunities that will be examined in relation to the use of the digital platform. This includes theoretical considerations from various disciplines within area management and visitor monitoring to technical, educational, socio-cultural and experiential reflections on visitors’ use of digital learning in recreational areas. Two project groups, one in Sweden and one in New Zealand, are responsible for the project.
|
|
| 24. |
- Sundell, J., et al.
(författare)
-
Prediction of Undetected Faults in Safety-Critical Software
- 2019
-
Ingår i: 2019 IEEE International Conference on Software Testing, Verification and Validation Workshops (ICSTW). - : IEEE. - 9781728108889
-
Konferensbidrag (refereegranskat)abstract
- Safety-critical software systems need to meet exceptionally strict standards in terms of dependability. Best practice to achieve this is to follow and develop the software according to domain specific standards. These standards give guidelines on development and testing activities. The challenge is that even if you follow the steps of the appropriate standard you have no quantification of the amount of faults potentially still lingering in the system. This paper presents a way to statistically estimate the amount of undetected faults, based on test results.
|
|
| 25. |
- Sundell, Johan, et al.
(författare)
-
Prediction of undetected faults in safety-critical software
- 2019
-
Ingår i: Proceedings - 2019 IEEE 12th International Conference on Software Testing, Verification and Validation Workshops, ICSTW 2019. - Xi'an, China. ; , s. 296-304
-
Konferensbidrag (refereegranskat)abstract
- Safety-critical software systems need to meet exceptionally strict standards in terms of dependability. Best practice to achieve this is to follow and develop the software according to domain specific standards. These standards give guidelines on development and testing activities. The challenge is that even if you follow the steps of the appropriate standard you have no quantification of the amount of faults potentially still lingering in the system. This paper presents a way to statistically estimate the amount of undetected faults, based on test results.
|
|
| 26. |
- Torkar, Richard, 1971, et al.
(författare)
-
Statistical and practical significance of empirical software engineering research: A maturity model
- 2017
-
Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)abstract
- Software engineering research is maturing and papers increasingly support their arguments with empirical data from a multitude of sources, using statistical tests to judge if and to what degree empirical evidence supports their hypotheses. This paper presents trends and current state of art regarding statistical maturity in empirical software engineering research; the objective being the development of a statistical maturity model. First, we manually reviewed papers from four well-known and top ranked journals producing a review protocol along with the view of current (2015) state of art concerning statistical maturity, practical significance and reproducibility of empirical software engineering research. Our protocol was then used as ground truth, i.e., training set, for a semi-automatic classification of studies for the years 2001--2015 using a total of 3,011 papers. We used the extracted data to develop a statistical maturity model which also includes a model for how to argue for practical significance. The statistical maturity of empirical software engineering research has an upward trend in certain areas (e.g., use of nonparametric statistics, but also more generally in the usage of quantitative analysis). However, we also see how our research area currently often fails to connect the statistical analysis to practical significance. For instance, we argue that conclusions should explicitly state contributions to software engineering practice, e.g., the return on investment for practitioners. We argue that the statistical maturity model can be used by researchers and practitioners to build a coherent statistical analysis and guide them in the choice of statistical approaches of its steps. The final goal for a researcher would be to, in a clearer way, present and argue for the practical significance of their findings. Bayesian analysis, we believe, has a role to play in this.
|
|
