| 1. |
- Berger, Christian, 1980, et al.
(författare)
-
The use of AI in AV human-factors research and human-factors requirements in AI-based AV design : Deliverable 2.4 in the EC ITN project SHAPE-IT
- 2023
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- The design of automated vehicles (AVs) today is being enabled by the rise of new technologies, actually in particular recent advances in Artificial Intelligence (AI). Navigating the challenges and potential of this technology is crucial for the organizations that develop AVs, as well as for societies that rely on smart transportation. In this report, we consider two perspectives on these technologies in AV research and design, with a particular focus on human factors (HF): (A) Human-Factors Requirements in AV Development, and (B) The Use of AI in Research about Vehicle-Human-Interaction. We describe each part separately; they are different enough to stand on their own, while both descriptions together make up this report. We start with the first perspective – investigating how AI can facilitate HF research and practical use of AI to predict human behaviour for use by HF designers. To support HF researchers and automation designers with tools for classifying and predicting interaction behaviours between AVs/vehicles and pedestrians in urban environments, we developed AI-based models (eg., Zhang et al., 2023) to predict the outcomes of pedestrian-vehicle interactions at unsignalised crossings. The models include random forest models, support vector machine models, and neural network models. The input consists of multiple features such as time to arrival (TTA), pedestrian waiting time, presence of a zebra crossing, and properties and personality traits of both pedestrians and drivers. The output consists of interaction outcomes such as crossing behaviour, crossing duration, and crossing initiation time. The predicted outcomes can contribute to a better understanding of the interactions. In addition, we analysed the interaction factors in order to support HF researchers and automation designers in their efforts to design safer interaction interface. We reviewed a large selection of papers that used AI to predict pedestrian behaviour and interactions (Zhang and Berger, 2023). We proposed a framework of AI-based tools for predicting pedestrian behaviours and summarized some guidelines for using AI—especially deep learning methods for pedestrian behaviour and interaction prediction. Furthermore, our own body of work (Zhang et al., 2021, Zhang and Berger, 2022a, Zhang and Berger, 2022b, Zhang et al., 2023) provides detailed steps for developing an example of an AI model. A key contribution of our research is metrics that allow the evaluation and assessment of AI’s success at classifying and predicting pedestrian-vehicle interactions. In our study, we compared AI models with traditional linear models (Zhang et al., 2023). Further, we compared the performance of AI models and traditional methods with fewer input factors; traditional methods perform well when there are fewer, while AI-based methods perform better when dealing with more input factors. This finding provides information for optimal model selection in different scenarios. To summarize, our findings suggest that AI can help us understand the intentions of human actors and predict their next steps when they interact with AVs. The second perspective investigates how HF research can facilitate AV development activities. We had anticipated that the reliance of AV on AI technology might play a major role in how developers need to think about HF (hence, this aspect is also reflected in the title of this report). Our reasoning was that AI-based AV provide a larger surface of interaction between humans and AVs, not only through the traditional human machine interface. However, early in the project we identified that there was a need to address not only the AI-based aspects of HF requirements in AV development, but also to address HF requirements overall in AV development – not the least within agile ways of working. We therefore decided to include AI-based AV development considerations as part of the larger scope of studying HF requirements in the context of AV development, with focus on agile processes. The agile angle was chosen as AV development increasingly incorporates agile and continuous development approaches. We find that it is conceptually unclear how to systematically incorporate HF in such a fast-paced environment. Further, the automotive industry used as our subject of study is lacking guidelines (as well as best practices) for incorporating HF into these ways of working. We propose the development and application of a HF requirements strategy to manage key implications, for which our research suggests useful templates and guidelines.
|
|
| 2. |
- de Winter, Joost, et al.
(författare)
-
Design strategies and prototype HMI designs for pedestrians, cyclists, and non-automated cars : Deliverable D2.5 in the EC ITN project SHAPE-IT
- 2023
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- This work provides a summary of work within the project SHAPE-IT (Supporting the interaction of Humans and Automated vehicles: Preparing for the Environment of Tomorrow) concerning HMI design for pedestrians, cyclists, and to some extent car drivers. We present the lessons learned from doctoral candidates (ESRs) who were involved with HMI design using augmented reality and connectivity. The lessons learned, which are discussed in this work, relate to if and how human-machine-interface (HMI) information should be presented to end users. The underlying philosophy is that through augmented reality (AR) and connectivity, virtual information in the form of warnings, instructions, and affordances can essentially be displayed at any location in the environment, or even be removed from the environment, to, for example, create transparent objects. However, just because something falls within the realm of technical possibilities and is theoretically interesting, does not imply that users will understand the information and can process it efficiently, or whether they would find it worthwhile and acceptable compared to no information or more traditional forms of HMI communication. This deliverable should serve as a useful reference for researchers and HMI designers who are involved in road transport. The report is structured as a core with accompanying already published journal articles as appendices.
|
|
| 3. |
- Figalova, Nikol, et al.
(författare)
-
Methodological Framework for Modelling and Empirical Approaches (Deliverable D1.1 in the H2020 MSCA ITN project SHAPE-IT)
- 2021
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- The progress in technology development over the past decades, both with respect to software and hardware, offers the vision of automated vehicles as means of achieving zero fatalities in traffic. However, the promises of this new technology – an increase in road safety, traffic efficiency, and user comfort – can only be realized if this technology is smoothly introduced into the existing traffic system with all its complexities, constraints, and requirements. SHAPE- IT will contribute to this major undertaking by addressing research questions relevant for the development and introduction of automated vehicles in urban traffic scenarios. Previous research has pointed out several research areas that need more attention for a successful implementation and deployment of human-centred vehicle automation in urban environments. In SHAPE-IT, for example, a better understanding of human behaviour and the underlying psychological mechanisms will lead to improved models of human behaviour that can help to predict the effects of automated systems on human behaviour already during system development. Such models can also be integrated into the algorithms of automated vehicles, enabling them to better understand the human interaction partners’ behaviours. Further, the development of vehicle automation is much about technology (software and hardware), but the users will be humans and they will interact with humans both inside and outside of the vehicle. To be successful in the development of automated vehicles functionalities, research must be performed on a variety of aspects. Actually, a highly interdisciplinary team of researchers, bringing together expertise and background from various scientific fields related to traffic safety, human factors, human-machine interaction design and evaluation, automation, computational modelling, and artificial intelligence, is likely needed to consider the human-technology aspects of vehicle automation. Accordingly, SHAPE-IT has recruited fifteen PhD candidates (Early Stage Researchers – ESRs), that work together to facilitate this integration of automated vehicles into complex urban traffic by performing research to support the development of transparent, cooperative, accepted, trustworthy, and safe automated vehicles. With their (and their supervisors’) different scientific background, the candidates bring different theoretical concepts and methodological approaches to the project. This interdisciplinarity of the project team offers the unique possibility for each PhD candidate to address research questions from a broad perspective – including theories and methodological approaches of other interrelated disciplines. This is the main reason why SHAPE-IT has been funded by the European Commission’s Marie Skłodowska-Curie Innovative Training Network (ITN) program that is aimed to train early state researchers in multidisciplinary aspects of research including transferable skills. With the unique scope of SHAPE-IT, including the human-vehicle perspective, considering different road-users (inside and outside of the vehicle), addressing for example trust, transparency, and safety, and including a wide range of methodological approaches, the project members can substantially contribute to the development and deployment of safe and appreciated vehicle automation in the cities of the future. To achieve the goal of interdisciplinary research, it is necessary to provide the individual PhD candidate with a starting point, especially on the different and diverse methodological approaches of the different disciplines. The empirical, user-centred approach for the development and evaluation of innovative automated vehicle concepts is central to SHAPE- IT. This deliverable (D1.1 “Methodological Framework for Modelling and Empirical Approaches”) provides this starting point. That is, this document provides a broad overview of approaches and methodologies used and developed by the SHAPE-IT ESRs during their research. The SHAPE-IT PhD candidates, as well as other researchers and developers outside of SHAPE-IT, can use this document when searching for appropriate methodological approaches, or simply get a brief overview of research methodologies often employed in automated vehicle research. The first chapter of the deliverable shortly describes the major methodological approaches to collect data relevant for investigating road user behaviour. Each subchapter describes one approach, ranging from naturalistic driving studies to controlled experiments in driving simulators, with the goal to provide the unfamiliar reader with a broad overview of the approach, including its scope, the type of data collected, and its limitations. Each subchapter ends with recommendations for further reading – literature that provide much more detail and examples. The second chapter explains four different highly relevant tools for data collection, such as interviews, questionnaires, physiological measures, and as other current tools (the Wizard of Oz paradigm and Augmented and Virtual Reality). As in the first chapter this chapter provides the reader with information about advantages and disadvantages of the different tools and with proposed further readings. The third chapter deals with computational models of human/agent interaction and presents in four subchapters different modelling approaches, ranging from models based on psychological mechanisms, rule-based and artificial intelligence models to simulation models of traffic interaction. The fourth chapter is devoted to Requirements Engineering and the challenge of communicating knowledge (e.g., human factors) to developers of automated vehicles. When forming the SHAPE-IT proposal it was identified that there is a lack of communication of human factors knowledge about the highly technical development of automated vehicles. This is why it is highly important that the SHAPE-IT ESRs get training in requirement engineering. Regardless of the ESRs working in academia or industry after their studies it is important to learn how to communicate and disseminate the findings to engineers. The deliverable ends with the chapter “Method Champions”. Here the expertise and association of the different PhD candidates with the different topics are made explicit to facilitate and encourage networking between PhDs with special expertise and those seeking support, especially with regards to methodological questions.
|
|
| 4. |
- Heyn, Hans-Martin, 1987, et al.
(författare)
-
Requirement Engineering Challenges for AI-intense Systems Development
- 2021
-
Ingår i: ICSE '21: Proceedings of the 1st Workshop on AI Engineering – Software Engineering for AI.
-
Konferensbidrag (refereegranskat)abstract
- Availability of powerful computation and communication technology as well as advances in artificial intelligence enable a new generation of complex, AI-intense systems and applications. Such systems and applications promise exciting improvements on a societal level, yet they also bring with them new challenges for their development. In this paper we argue that significant challenges relate to defining and ensuring behaviour and quality attributes of such systems and applications. We specifically derive four challenge areas from relevant use cases of complex, AI-intense systems and applications related to industry, transportation, and home automation: understanding, determining, and specifying (i) contextual definitions and requirements,(ii) data attributes and requirements, (iii) performance definition and monitoring, and (iv) the impact of human factors on system acceptance and success. Solving these challenges will imply process support that integrates new requirements engineering methods into development approaches for complex, AI-intense systems and applications. We present these challenges in detail and propose a research roadmap.
|
|
| 5. |
- Merat, Natasha, et al.
(författare)
-
An Overview of Interfaces for Automated Vehicles (inside/outside) (Deliverable D2.1 in the H2020 MSCA ITN project SHAPE-IT)
- 2021
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- This Deliverable starts with a short overview of the design principles and guidelines developed for current Human Machine Interfaces (HMIs), which are predominantly developed for manually driven vehicles, or those with a number of Advanced Driver Assistance Systems (ADAS), at SAE Levels 0 and 1 (SAE, 2018). It then provides an overview of how the addition of more capable systems, and the move to higher levels of vehicle automation, is changing the role the human inside an Automated Vehicle (AV), and the ways in which future automated vehicles at higher levels of automation (SAE level 4 and 5) must communicate with other road users, in the absence of an “in charge” human driver. It is argued that such changes in the role of the driver, and more transfer of control to the AV and its different functionalities, means that there will be more emphasis on the roles and responsibilities of HMIs for future AVs. In parallel, the multifaceted nature of these HMI, presented from different locations, both in and outside the vehicles, using a variety of modalities, and engaging drivers in a two-way interaction, means that a new set of design guidelines are required, to ensure that the humans interacting with AVs (inside and outside the vehicle) are not distracted and overloaded, that they remain situation aware and understand the capabilities and limitations of the system, having the right mental model of system capabilities and their responsibilities, as responsible road users, at all times Following a summary of suggested frameworks and design principles which highlight the significant change needed for new AV HMIs, an overview of results from studies investigating human interaction with internal (or iHMIs), and external (or eHMIs), is provided, with examples of new and innovative methods of communication between humans and their vehicles. The Deliverable then provides a summary of the innovative approaches that will be tackled by the ESRs of the project, which focus on factors such as use of AI and AR for future design of more intuitive and transparent HMI, studying how HMI can support the long term interaction of humans with AVs, and the use of neuroergonomic methods for developing safer HMIs. The Deliverable concludes by summarising how each ESR’s project contributes to the development of HMIs for future AVs.
|
|
| 6. |
- Merat, Natasha, et al.
(författare)
-
Design guidelines for acceptable, transparent, and safe AVs in urban environments : Deliverable 2.6 in the EC ITN project SHAPE-IT
- 2023
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- This Deliverable summarises the work of ESRs 1, 5, 7 and 12 of the SHAPE-IT project that considered how a range of human states such as attention, fatigue and mental workload are affected by SAE Level 2 and 3 automated vehicles (AVs), when compared to manual driving, and what this means for AV and road safety. The studies also consider how AV safety and acceptance can increase with Human Machine Interface (HMI) transparency, and what factors contribute to the improvement of this transparency. An investigation of what aspects of an AV’s HMIs, its driving environment and driving style, contribute to the perceived safety, comfort and trust for its users is provided, and new methods and frameworks for enhancing these states are introduced. By considering how human factors concepts and knowledge should be embraced by software developers and AV engineers, ESRs 8 and 15 highlight the importance of a multidisciplinary approach to AV development. Finally, the work of ESR2 focuses on how AV trust, acceptance, and transparency changes with prolonged and repeated use of AVs, emphasising that successful deployment of AVs must embrace human factors knowledge during all stages of AV development. This work also highlights that as long as AVs require human interaction and intervention, including a diverse user group, and ensuring the appropriate level of trust is built at each stage of the interaction, will improve the correct and safe use of AVs.
|
|
| 7. |
- Muhammad, Amna Pir, 1990, et al.
(författare)
-
Continuous Experimentation and Human Factors An Exploratory Study
- 2024
-
Ingår i: Lecture Notes in Computer Science. - : Springer. - 0302-9743 .- 1611-3349. ; 14483, s. 511-526
-
Konferensbidrag (refereegranskat)abstract
- In today's rapidly evolving technological landscape, the success of tools and systems relies heavily on their ability to meet the needs and expectations of users. User-centered design approaches, with a focus on human factors, have gained increasing attention as they prioritize the human element in the development process. With the increasing complexity of software-based systems, companies are adopting agile development methodologies and emphasizing continuous software experimentation. However, there is limited knowledge on how to effectively execute continuous experimentation with respect to human factors within this context. This research paper presents an exploratory qualitative study for integrating human factors in continuous experimentation, aiming to uncover distinctive characteristics of human factors and continuous software experiments, practical challenges for integrating human factors in continuous software experiments, and best practices associated with the management of continuous human factors experimentation.
|
|
| 8. |
- Muhammad, Amna Pir, 1990, et al.
(författare)
-
Human factors in developing automated vehicles: A requirements engineering perspective
- 2023
-
Ingår i: Journal of Systems and Software. - 0164-1212. ; 205
-
Tidskriftsartikel (refereegranskat)abstract
- Automated Vehicle (AV) technology has evolved significantly both in complexity and impact and is expected to ultimately change urban transportation. Due to this evolution, the development of AVs challenges the current state of automotive engineering practice, as automotive companies increasingly include agile ways of working in their plan-driven systems engineering-or even transition completely to scaled-agile approaches. However, it is unclear how knowledge about human factors (HF) and technological knowledge related to the development of AVs can be brought together in a way that effectively supports today's rapid release cycles and agile development approaches. Based on semi-structured interviews with ten experts from industry and two experts from academia, this qualitative, exploratory case study investigates the relationship between HF and AV development. The study reveals relevant properties of agile system development and HF, as well as the implications of these properties for integrating agile work, HF, and requirements engineering. According to the findings, which were evaluated in a workshop with experts from academia and industry, a culture that values HF knowledge in engineering is key. These results promise to improve the integration of HF knowledge into agile development as well as to facilitate HF research impact and time to market.& COPY; 2023 The Author(s). Published by Elsevier Inc. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
|
|
| 9. |
- Muhammad, Amna Pir, 1990
(författare)
-
Methods and Guidelines for Incorporating HumanFactors Requirements in Automated Vehicles
- 2021
-
Ingår i: In proceedings of REFSQ2021.
-
Konferensbidrag (refereegranskat)abstract
- Automated vehicles (AV) are transforming the future of the transportation and improving the qualityof life. However, due to their societal impact in urban environments, AV development challenges thecurrent development process. Particularly, it is unclear how human factors requirements can be com-municated to developers of AI-based AV. It is quite challenging especially in agile development, wherethe focus is on continuous deployment and rapid release cycles with short lead-times.Due to the importance of human factors and its impact on trust, acceptance, and safety of AV inurban environments, my work aims at providing a suitable requirements engineering perspective andmethod.
|
|
| 10. |
- Pir Muhammad, Amna, 1990, et al.
(författare)
-
Defining Requirements Strategies in Agile: A Design Science Research Study
- 2022
-
Ingår i: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). - Cham : Springer International Publishing. - 1611-3349 .- 0302-9743. ; 13709 LNCS, s. 73-89
-
Konferensbidrag (refereegranskat)abstract
- Research shows that many of the challenges currently encountered with agile development are related to requirements engineering. Based on design science research, this paper investigates critical challenges that arise in agile development from an undefined requirements strategy. We explore potential ways to address these challenges and synthesize the key building blocks of requirements strategies. Our design science research rests on a multiple case study with three industrial cases in the domains of communication technology, security services, and automotive. We relied on a total of 20 interviews, two workshops, participant observation in two cases, and document analysis in each of the cases to understand concrete challenges and workflows. In each case, we define a requirements strategy in collaboration with process managers and experienced engineers. From this experience, we extract guidelines for defining requirements strategies in agile development.
|
|
| 11. |
- Pir Muhammad, Amna, 1990
(författare)
-
Managing Human Factors and Requirements in Agile Development of Automated Vehicles: An Exploration
- 2022
-
Licentiatavhandling (övrigt vetenskapligt/konstnärligt)abstract
- Context: Automated Vehicle (AV) technology has evolved significantly in complexity and impact; it is expected to ultimately change urban transporta- tion. However, research shows that vehicle automation can only live up to this expectation if it is defined with human capabilities and limitations in mind. Therefore, it is necessary to bring human factors knowledge to AV developers. Objective: This thesis aims to empirically study how we can effectively bring the required human factors knowledge into large-scale agile AV develop- ment. The research goals are 1) to explore requirements engineering and human factors in agile AV development, 2) to investigate the problems of requirements engineering, human factors, and agile way of working in AV development, and 3) to demonstrate initial solutions to existing problems in agile AV development. Method: We conducted this research in close collaboration with industry, using different empirical methodologies to collect data—including interviews, workshops, and document analysis. To gain in-depth insights, we did a qualita- tive exploratory study to investigate the problem and used a design science approach to develop initial solution in several iterations. Findings and Conclusions: We found that applying human factors knowledge effectively is one of the key problem areas that need to be solved in agile development of artificial intelligence (AI)-intense systems. This motivated us to do an in-depth interview study on how to manage human factors knowl- edge during AV development. From our data, we derived a working definition of human factors for AV development, discovered the relevant properties of agile and human factors, and defined implications for agile ways of working, managing human factors knowledge, and managing requirements. The design science approach allowed us to identify challenges related to agile requirements engineering in three case companies in iterations. Based on these three case studies, we developed a solution strategy to resolve the RE challenges in agile AV development. Moreover, we derived building blocks and described guide- lines for the creation of a requirements strategy, which should describe how requirements are structured, how work is organized, and how RE is integrated into the agile work and feature flow. Future Outlook: In future work, I plan to define a concrete requirement strategy for human factors knowledge in large-scale agile AV development. It could help establishing clear communication channels and practices for incorporating explicit human factors knowledge into AI-based large-scale agile AV development.
|
|
| 12. |
- Pir Muhammad, Amna, 1990, et al.
(författare)
-
Managing Human Factors in Automated Vehicle Development: Towards Challenges and Practices
- 2023
-
Ingår i: Proceedings of the IEEE International Conference on Requirements Engineering. - 2332-6441 .- 1090-705X. ; 2023-September, s. 347-352
-
Konferensbidrag (refereegranskat)abstract
- Due to the technical complexity and social impact, automated vehicle (AV) development challenges the current state of automotive engineering practice. Research shows that it is important to consider human factors (HF) knowledge when developing AVs to make them safe and accepted. This study explores the current practices and challenges of the automotive industries for incorporating HF requirements during agile AV development. We interviewed ten industry professionals from several Swedish automotive companies, including HF experts and AV engineers. Based on our qualitative analysis of the semi-structured interviews, a number of current approaches for communicating and incorporating HF knowledge into agile AV development and associated challenges are discussed. Our findings may help to focus future research on issues that are critical to effectively incorporate HF knowledge into agile AV development.
|
|
