| 1. |
- Falessi, Davide, et al.
(författare)
-
Empirical software engineering experts on the use of students and professionals in experiments
- 2018
-
Ingår i: Empirical Software Engineering. - : Springer New York LLC. - 1382-3256 .- 1573-7616. ; 23:1, s. 452-489
-
Tidskriftsartikel (refereegranskat)abstract
- [Context] Controlled experiments are an important empirical method to generate and validate theories. Many software engineering experiments are conducted with students. It is often claimed that the use of students as participants in experiments comes at the cost of low external validity while using professionals does not. [Objective] We believe a deeper understanding is needed on the external validity of software engineering experiments conducted with students or with professionals. We aim to gain insight about the pros and cons of using students and professionals in experiments. [Method] We performed an unconventional, focus group approach and a follow-up survey. First, during a session at ISERN 2014, 65 empirical researchers, including the seven authors, argued and discussed the use of students in experiments with an open mind. Afterwards, we revisited the topic and elicited experts’ opinions to foster discussions. Then we derived 14 statements and asked the ISERN attendees excluding the authors, to provide their level of agreement with the statements. Finally, we analyzed the researchers’ opinions and used the findings to further discuss the statements. [Results] Our survey results showed that, in general, the respondents disagreed with us about the drawbacks of professionals. We, on the contrary, strongly believe that no population (students, professionals, or others) can be deemed better than another in absolute terms. [Conclusion] Using students as participants remains a valid simplification of reality needed in laboratory contexts. It is an effective way to advance software engineering theories and technologies but, like any other aspect of study settings, should be carefully considered during the design, execution, interpretation, and reporting of an experiment. The key is to understand which developer population portion is being represented by the participants in an experiment. Thus, a proposal for describing experimental participants is put forward.
|
|
| 2. |
|
|
| 3. |
- Holmén Notander, Jesper, et al.
(författare)
-
Challenges in Flexible Safety-Critical Software Development -- An Industrial Qualitative Survey
- 2013
-
Ingår i: Lecture Notes in Computer Science/Product-Focused Software Process Improvement. - Berlin, Heidelberg : Springer Berlin Heidelberg. - 1611-3349 .- 0302-9743. - 9783642392580 ; 7983, s. 283-297
-
Konferensbidrag (refereegranskat)abstract
- Context. Development of safety-critical systems is mostly governed by process-heavy paradigms, while increasing demands on flexibility and agility also reach this domain. Objectives. We wanted to explore in more detail the industrial needs and challenges when facing this trend. Method. We launched a qualitative survey, interviewing engineers from four companies in four different industry domains. Results. The survey identifies human factors (skills, experience, and attitudes) being key in safety-critical systems development, as well as good documentation. Certification cost is related to change frequency, which is limiting flexibility. Component reuse and iterative processes were found to increase adaptability to changing customer needs. Conclusions. We conclude that agile development and flexibility may co-exist with safety-critical software development, although there are specific challenges to address.
|
|
| 4. |
- Höst, Martin, et al.
(författare)
-
Modeling the Effects of Project Management Strategies on Long-Term Product Knowledge
- 2012
-
Ingår i: Product-Focused Software Process Improvement/Lecture Notes in Computer Science. - Berlin, Heidelberg : Springer Berlin Heidelberg. - 0302-9743 .- 1611-3349. - 9783642310621 ; 7343, s. 104-115
-
Konferensbidrag (refereegranskat)abstract
- Abstract in UndeterminedIn a team, people sometimes leave the team and become replaced by new persons with less experience, and sometimes people participate in new activities and thereby obtain new knowledge. Different processes, in terms of different management strategies, can be followed, e.g., to introduce people to new tasks so they get new knowledge. There is a need to investigate the long term effects of different strategies on a team's software product knowledge. This paper presents an initial approach for how this type of knowledge can be modeled as a stochastic process. Metrics representing the long term effects on knowledge are derived, and two different example strategies are investigated numerically. Based on this it is discussed how the model can be further elaborated and evaluated.
|
|
| 5. |
- Johnsson, Björn A, et al.
(författare)
-
Evaluating a GUI Development Tool for Internet of Things and Android
- 2016
-
Ingår i: Product-Focused Software Process Improvement : 17th International Conference, PROFES 2016, Trondheim, Norway, November 22-24, 2016, Proceedings - 17th International Conference, PROFES 2016, Trondheim, Norway, November 22-24, 2016, Proceedings. - Cham : Springer International Publishing. - 9783319490939 - 9783319490946 ; , s. 181-197
-
Konferensbidrag (refereegranskat)abstract
- In the emerging field of Internet of Things (IoT), where computerized devices are combined in creative new ways, there is a need to create Graphical User Interfaces (GUIs) for the systems being built, e.g. in the form of Android “apps”. This is generally a complicated, time consuming task. We report from a controlled experiment that evaluates a new approach for building GUIs that aims to make it easier for more people to build quality GUIs. A tool supporting the new approach (GPE) was compared to Android Studio (AS), the industry standard for Android development. Our data analysis shows that GPE is more effective than AS when performing certain tasks, with no measurable degrade in the quality of the produced GUIs. We conclude that non-Android developers and Android developers alike should consider using GPE rather than AS when building Android GUIs for PalCom based IoT systems.
|
|
| 6. |
- Petersen, Kai, et al.
(författare)
-
Revisiting the construct and assessment of industrial relevance in software engineering research within
- 2024
-
Ingår i: 1st International Workshop on Methodological Issues with Empirical Studies in Software Engineering.
-
Konferensbidrag (refereegranskat)abstract
- Industrial relevance is essential for an applied research area like software engineering. However, it is unclear how to achieve industrial relevance and how we communicate and assess it. We propose a reasoning framework to support the design, reporting, and assessment of research for industrial relevance.
|
|
| 7. |
- Runeson, Per, et al.
(författare)
-
A Conceptual Framework and Recommendations for Open Data and Artifacts in Empirical Software Engineering
- 2024
-
Ingår i: 1st International Workshop on Methodological Issues with Empirical Studies in Software Engineering. - : Association for Computing Machinery (ACM).
-
Konferensbidrag (refereegranskat)abstract
- Open science aims to improve research accessibility, replicability, and consequently its quality. Empirical software engineering entails both data and artifacts, which may be shared more or less openly, to support transparency. However, the trade-offs involved in balancing the openness against integrity and secrecy concerns need methodological guidance. Aim. We aim to derive such advice, based on our own experiences from a research project, in the field of gaze-assisted code reviews – the Gander case. Method. We draw on literature about open data and artifacts in socio-technical research. Next, we describe our case project and derive a conceptual framework of steps in research data analysis and artifact development, using our data and artifacts as illustrating examples. Results. The conceptual framework contains 1) a categorization of humans involved as participants and their concerns, 2) four steps for data analysis, each resulting in corresponding data and meta-data, and 3) three steps of artifact distribution, matching different levels of openness. We derive a preliminary set of recommendations for open science practices for data and artifacts. Conclusion. The conceptual framework has proven useful in summarizing and discussing data and artifacts in the studied case project. We envision that the framework and recommendations will provide a foundation for further advancement of open science research practices in empirical, socio-technical software engineering.
|
|
