| 1. |
- Cheatle, Amy, et al.
(författare)
-
Sensing (Co)Operations : Articulation and Compensation in the Robotic Operating Room
- 2019
-
Ingår i: Proceedings of the ACM on Human-Computer Interaction. - : Association for Computing Machinery (ACM). - 2573-0142. ; 3:CSCW
-
Tidskriftsartikel (refereegranskat)abstract
- Drawing on ethnographic fieldwork in two different teaching hospitals that deployed the da Vinci surgical robot, this paper traces how the introduction of robotics reconfigures the sensory environment of surgery and how surgeons and their teams recalibrate their work in response. We explore the entangled and mutually supportive nature of sensing within and between individual actors and the broader world of people and things (with emphasis on vision and touch) and illustrate how such inter-sensory dependencies are challenged and sometimes extended under the conditions of robotic surgery. We illustrate how sensory (re)articulations and compensations allow the surgeon and surgical teams to adapt to a more-than-human sensorium and conclude by advocating new forms of sensory-aware design capable of enhancing and supporting embodied sensory conditions both individually and across teams.
|
|
| 2. |
- Keevallik, Leelo, Professor, 1969-, et al.
(författare)
-
F-formation
- 2023
-
Ingår i: The Encyclopedia of Terminology for Conversation Analysis and Interactional Linguistics. - : en Science Foundation.
-
Bokkapitel (övrigt vetenskapligt/konstnärligt)
|
|
| 3. |
- Kontogiorgos, Dimosthenis, 1987-, et al.
(författare)
-
Towards Adaptive and Least-Collaborative-Effort Social Robots
- 2020
-
Ingår i: Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. - New York, NY, USA : Association for Computing Machinery (ACM). ; , s. 311-313
-
Konferensbidrag (refereegranskat)abstract
- In the future, assistive social robots will collaborate with humans in a variety of settings. Robots will not only follow human orders but will likely also instruct users during certain tasks. Such robots will inevitably encounter user uncertainty and hesitations. They will continuously need to repair mismatches in common ground in their interactions with humans. In this work, we argue that social robots should instruct humans following the principle of least-collaborative-effort. Like humans do when instructing each other, robots should minimise information efficiency over the benefits of collaborative interactive behaviour. In this paper, we first introduce the concept of least-collaborative-effort in human communication and then discuss implications for design of instructions in human-robot collaboration.
|
|
| 4. |
- Passero, Sergio, Doktorand, et al.
(författare)
-
Honkable Gestalts : Why Autonomous Vehicles Get Honked At
- 2024
-
Ingår i: Proceeding at 16th International ACM Conference on Automotive User Interfaces and Interactive Vehicular Applications. Stanford, California, Usa. September 22-25, 2024.
-
Konferensbidrag (refereegranskat)abstract
- This paper analyzes honks directed at autonomous vehicles (AVs) by other drivers. As honks often mark problems, this focus allows us to better understand the challenges that AVs face in real traffic. Performing a sequential video analysis of 63 honk incidents uploaded by Tesla beta testers on YouTube, we identify how problematic situations emerge as honkable Traffic Gestalts. We identify four types of situated problems with AV driving performance marked by other drivers’ honks: they may wait too long, steer inconsistently, stop instead of going, and go too fast. We further show how a honk may be understandable as a warning, a nudge or a reprimand. Our work suggests designing honks for AVs to focus on relevant contexts, supported by developing bidirectional interfaces and audio analysis methods that consider the interplay of auditory and visual information in traffic.
|
|
| 5. |
- Pelikan, Hannah, 1994-
(författare)
-
"A Stubborn Child" - How Robot Sounds are Oriented to in Everyday Situated Interaction at Home
- 2019
-
Ingår i: Mensch und Computer 2019 - Workshopband. - Bonn, Germany. ; , s. 364-365
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- Humans make sense of robot actions in the situated context that these actions occur in. This paper takes a conversation analytic approach in studying how the social robot Cozmo is received in a family home, focusing on the non-lexical sounds that the robot uses to communicate. Preliminary findings suggest that participants treat the robot similar to a young child or pet and orient to the robot’s sounds in the local context of the interaction.
|
|
| 6. |
- Pelikan, Hannah, et al.
(författare)
-
"Are you sad, Cozmo?" How humans make sense of a home robot's emotion displays
- 2020
-
Ingår i: Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction (HRI'20). - New York, NY, USA : ACM Press. - 9781450367462 ; , s. 461-470
-
Konferensbidrag (refereegranskat)abstract
- This paper explores how humans interpret displays of emotion pro- duced by a social robot in real world situated interaction. Taking a multimodal conversation analytic approach, we analyze video data of families interacting with a Cozmo robot in their homes. Focusing on one happy and one sad robot animation, we study, on a turn-by-turn basis, how participants respond to audible and visible robot behavior designed to display emotion. We show how emotion animations are consequential for interactional progres- sivity: While displays of happiness typically move the interaction forward, displays of sadness regularly lead to a reconsideration of previous actions by humans. Furthermore, in making sense of the robot animations people may move beyond the designer’s re- ported intentions, actually broadening the opportunities for their subsequent engagement. We discuss how sadness functions as an interactional "rewind button" and how the inherent vagueness of emotion displays can be deployed in design.
|
|
| 7. |
- Pelikan, Hannah, 1994-, et al.
(författare)
-
Encountering Autonomous Robots on Public Streets
- 2024
-
Ingår i: Proceedings of the 2024 ACM/IEEE International Conference on Human-Robot Interaction (HRI ’24). - New York, NY, USA : ASSOC COMPUTING MACHINERY. - 9798400703225 ; , s. 561-571
-
Konferensbidrag (refereegranskat)abstract
- Robots deployed in public settings enter spaces that humans live and work in. Studies of HRI in public tend to prioritise direct and deliberate interactions. Yet this misses the most common form of response to robots, which ranges from subtle fleeting interactions to virtually ignoring them. Taking an ethnomethodological approach building on video recordings, we show how robots become embedded in urban spaces both from a perspective of the social assembly of the physical environment (the streetscape) and the socially organised nature of everyday street life. We show how such robots are effectively ‘granted passage’ through these spaces as a result of the practical work of the streets’ human inhabitants. We detail the contingent nature of the streetscape, drawing attention to its various members and the accommodation work they are doing. We demonstrate the importance of studying robots during their whole deployment, and approaches that focus on members’ interactional work.
|
|
| 8. |
- Pelikan, Hannah, 1994-, et al.
(författare)
-
Gender Studies and Robotics : A Dialogue
- 2021
-
Ingår i: Workshop Gendering Robots: Ongoing (Re)configurations of Gender in Robotics.
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- Sex and gender are becoming more relevant to Robotics and Artificial Intelligence researchers, who, for example, focus more on balancing male and female participants in studies. On the other hand, Gender Studies research engages an intersectional approach, and has gone beyond the binary, including other categories (e.g., class, race, age, ability). How can we take an intersectional approach to human-robot interaction?
|
|
| 9. |
- Pelikan, Hannah, 1994-, et al.
(författare)
-
Interaction Prototyping With Video: Bridging Video Interaction Analysis & Design
- 2022
-
Ingår i: CHI Conference on Human Factors in Computing Systems Extended Abstracts (CHI ’22 Extended Abstracts). - New York, NY, USA : ACM. - 9781450391566
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- In this course you will learn how to use video data for prototyping. The course provides hands-on training in working with video clips, including transcription and identification of relevant actions. You will familiarize with core interaction analytic concepts (grounded in ethnomethodology and conversation analysis) and will learn how to do an action-by-action analysis. Working on the design case of everyday interaction with automatic doors, you will learn how video interaction analysis can be embedded in an iterative design process.
|
|
| 10. |
- Pelikan, Hannah, 1994-, et al.
(författare)
-
Learning from humans : How research on vocalizations can inform the conceptualization of robot sound
- 2023
-
Ingår i: Sound and Robotics. - New York : Chapman and Hall. - 9781003320470
-
Bokkapitel (refereegranskat)abstract
- When aiming to design for intuitive interaction, a good understanding of hu- man behavior is essential. In this chapter we dive into studies on how humans use vocalizations and prosody in everyday interaction. Contrasting six ex- amples from human-human and human-robot interaction, we highlight how insights on human practices can inform the design of robot sound in interac- tion. We present three main lessons, demonstrating that a) both human vo- calizations and robot sound are semantically underspecified, b) human sound production is embodied, and robot sound should therefore be analyzed and designed multimodally, and c) sound can be easily adapted for complex par- ticipation.
|
|
| 11. |
- Pelikan, Hannah, 1994-, et al.
(författare)
-
Managing Delays in Human-Robot Interaction
- 2023
-
Ingår i: ACM Transactions on Computer-Human Interaction. - : ACM Digital Library. - 1073-0516 .- 1557-7325. ; 30:4
-
Tidskriftsartikel (refereegranskat)abstract
- Delays in the completion of joint actions are sometimes unavoidable. How should a robot communicate that it cannot immediately act or respond in a collaborative task? Drawing on video recordings of a face scanning activity in family homes, we investigate how humans make sense of a Cozmo robot’s delays on a moment-by-moment basis. Cozmo’s sounds and embodied actions are recognized as indicators of delay but encourage human participants to act in ways that undermine the scanning process. In comparing the robot’s delay management strategies with human-human vocal and embodied practices, we demonstrate key differences in the sequences that impact how the robot is understood. The study demonstrates how delay events are accomplished as embodied displays that are distributed across co-participants. We present a framework for making delay transparent through situated explanations, particularly in the form of non-lexical sounds and bodily actions.
|
|
| 12. |
- Pelikan, Hannah, 1994-, et al.
(författare)
-
Människa–robot-interaktion : ämnesområde: datavetenskap
- 2020
-
Ingår i: Multimodal interaktionsanalys. - Lund : Studentlitteratur AB. - 9789144127521 ; , s. 395-415
-
Bokkapitel (övrigt vetenskapligt/konstnärligt)abstract
- Vi är dagligen beroende av olika teknologier som är programmerade för att interagera med människor. Robotar är förkroppsligade artificiella agenter som hjälper oss att hitta vägen på flygplatsen, undervisar barn i att räkna och tar hand om våra äldre. Det är självklart viktigt att sådan uppdrag sköts med finkänslighet och att någon slags "förståelse" uppnås mellan människa och maskin.
|
|
| 13. |
- Pelikan, Hannah, 1994-, et al.
(författare)
-
Operating at a Distance - How a Teleoperated Surgical Robot Reconfigures Teamwork in the Operating Room
- 2018
-
Ingår i: Proc. ACM Hum.-Comput. Interact.. - : Association for Computing Machinery (ACM). - 2573-0142. ; 2:CSCW
-
Tidskriftsartikel (refereegranskat)abstract
- This paper investigates how a teleoperated surgical robot reconfigures teamwork in the operating room by spatially redistributing team members. We report on findings from two years of fieldwork at two hospitals, including interviews and video data. We find that while in non-robotic cases team members huddle together, physically touching, introduction of a surgical robot increases physical and sensory distance between team members. This spatial rearrangement has implications for both cognitive and affective dimensions of collaborative surgical work. Cognitive distance is increased, necessitating new efforts to maintain situation awareness and common ground. Moreover, affective distance is introduced, decreasing sensitivity to shared and non-shared affective states and leading to new practices aimed at restoring affective connection within the team. We describe new forms of physical, cognitive, and affective distance associated with teleoperated robotic surgery, and the effects these have on power distribution, practice, and collaborative experience within the surgical team.
|
|
| 14. |
- Pelikan, Hannah R. M., 1994-, et al.
(författare)
-
Designing Robot Sound-In-Interaction : The Case of Autonomous Public Transport Shuttle Buses
- 2023
-
Ingår i: HRI '23. - New York, NY, USA : ACM Digital Library. - 9781450399647 ; , s. 172-182
-
Konferensbidrag (refereegranskat)abstract
- Horns and sirens are important tools for communicating on the road, which are still understudied in autonomous vehicles. While HRI has explored different ways in which robots could sound, we focus on the range of actions that a single sound can accomplish in interaction. In a Research through Design study involving autonomous shuttle buses in public transport, we explored sound design with the help of voice-overs to video recordings of the buses on the road and Wizard-of-Oz tests in live traffic. The buses are slowed down by (unnecessary) braking in response to people getting close. We found that prolonged jingles draw attention to the bus and invite interaction, while repeated short beeps and bell sounds can instruct the movement of others away from the bus. We highlight the importance of designing sound in sequential interaction and describe a new method for embedding video interaction analysis in the design process.
|
|
| 15. |
- Pelikan, Hannah R. M., 1994-, et al.
(författare)
-
Designing Robot Sound-In-Interaction: The Case of Autonomous Public Transport Shuttle Buses
- 2023
-
Ingår i: <em>Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction</em>. - New York, NY, USA : Association for Computing Machinery (ACM). ; , s. 172-182
-
Konferensbidrag (refereegranskat)abstract
- Horns and sirens are important tools for communicating on the road, which are still understudied in autonomous vehicles. While HRI has explored different ways in which robots could sound, we focus on the range of actions that a single sound can accomplish in interaction. In a Research through Design study involving autonomous shuttle buses in public transport, we explored sound design with the help of voice-overs to video recordings of the buses on the road and Wizard-of-Oz tests in live traffic. The buses are slowed down by (unnecessary) braking in response to people getting close. We found that prolonged jingles draw attention to the bus and invite interaction, while repeated short beeps and bell sounds can instruct the movement of others away from the bus. We highlight the importance of designing sound in sequential interaction and describe a new method for embedding video interaction analysis in the design process.
|
|
| 16. |
- Pelikan, Hannah R. M., 1994-
(författare)
-
Tackling Interactional Challenges in Social Robots: A Multimodal Conversation Analytic Approach
- 2019
-
Konferensbidrag (refereegranskat)abstract
- The field of social robotics has grown considerably in recent years and social and collaborative robots have entered the consumer market. However, communicative aspects such as timing of utterances and correct interpretation of actions remain a major challenge for social robots. In this position paper I argue that to build collaborative robotic systems that act in socially and interactionally appropriate ways, we need to focus on humans as "the other" in robot-human interaction, whom robotic utterances should be designed for. I present multimodal conversation analysis (CA), a video-based approach that focuses on how actions are interpreted by participants in the context of the ongoing interaction. Identifying three different scales at which CA can be applied, I demonstrate how this approach can support various stages of robot interaction design, making social robots easier to collaborate with from a human perspective.
|
|
| 17. |
- Pelikan, Hannah R. M., et al.
(författare)
-
Why That Nao? How Humans Adapt to a Conventional Humanoid Robot in Taking Turns-at-Talk
- 2016
-
Ingår i: 34TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2016. - New York, NY, USA : Association for Computing Machinery (ACM). - 9781450333627 ; , s. 4921-4932
-
Konferensbidrag (refereegranskat)abstract
- This paper explores how humans adapt to a conventional humanoid robot. Video data of participants playing a charade game with a Nao robot were analyzed from a multimodal conversation analysis perspective. Participants soon adjust aspects of turn-design such as word selection, turn length and prosody, thereby adapting to the robots limited perceptive abilities as they become apparent in the interaction. However, coordination of turns-at-talk remains troublesome throughout the encounter, as evidenced by overlapping turns and lengthy silences around possible turn endings. The study discusses how the robot design can be improved to support the problematic taking of turns-at-talk with humans. Two programming strategies to address the identified problems are presented: 1. to program the robot so that it will be systematically receptive at the equivalence to transition relevance places in human-human interaction, and 2. to make the robot preferably produce verbal actions that require a response in a conditional way, rather than making a response only possible.
|
|
| 18. |
- Pelikan, Hannah, 1994-
(författare)
-
Robot Sound in Interaction : Analyzing and Designing Sound for Human-Robot Coordination
- 2023
-
Doktorsavhandling (övrigt vetenskapligt/konstnärligt)abstract
- Robots naturally emit sound, but we still know little about how sound can serve as an interface that makes a robot’s behavior explainable to humans. This dissertation draws on insights about human practices for coordinating bodily activities through sound, investigating how they could inform robot design. My work builds on three video corpora, involving i) a Cozmo robot in ten family homes, ii) autonomous public shuttle buses in an urban environment, and iii) a teamwork robot prototype controlled by a researcher and interacting with study participants in an experimental setting. I approached the data from two methodological angles, exploring how they can speak to each other: I first carried out an empirical analysis of the video data from an Ethnomethodology and Conversation Analysis (EMCA) perspective, focusing on how humans make sense of robot sound on a moment-by-moment basis in naturally occurring interaction. Subsequently, taking an Interaction Design perspective, I used my video recordings as a design material for exploring how robot sound could be designed in and for real-time interaction. My work contributes to Human-Robot Interaction through detailed studies of robots in the world (rather than in the lab), focusing on how participants make sense of robot sounds. I present a novel framework for designing sound in and for interaction and a prototyping practice that allows practitioners to embed an EMCA stance into their designs. The dissertation contributes to EMCA by describing how members embed autonomous machines into the social organization of activities and how humans treat robots as participants in the interaction. I make a contribution to the development of EMCA hybrid studies by seeking a synthesis between EMCA and robot interaction design.
|
|
| 19. |
- Pelikan, Hannah
(författare)
-
Robot Sound-In-Interaction
- 2023
-
Ingår i: COMPANION OF THE ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, HRI 2023. - New York, NY, USA : ASSOC COMPUTING MACHINERY. - 9781450399708 ; , s. 754-756
-
Konferensbidrag (refereegranskat)abstract
- Sound is an important interaction modality in human interaction, which robot design is only starting to tap into. Drawing on insights about how human sounds support coordination of bodily activities, this work focuses on how robots can communicate through sound in concrete interactions in the wild. My work contributes a focus on how users make sense of sound in everyday interaction, promotes re-consideration of what HRI is designing for and stimulates the development of new HRI design methods.
|
|
| 20. |
- Pelikan, Hannah, 1994-, et al.
(författare)
-
Sound in Human-Robot Interaction
- 2021
-
Ingår i: HRI 21: COMPANION OF THE 2021 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION. - New York, NY, USA : Association for Computing Machinery (ACM). - 9781450382908 ; , s. 706-708
-
Konferensbidrag (refereegranskat)abstract
- Robot sound spans a wide continuum, from subtle motor hums, through music, bleeps and bloops, to human-inspired vocalizations, and can be an important means of communication for robotic agents. This first workshop on sound in HRI aims to bring together inter- disciplinary perspectives on sound, including design, conversation analysis, (computational) linguistics, music, engineering and psychology. The goal of the workshop is to stimulate interdisciplinary exchange and to form a more coherent overview of perspectives on how sound can facilitate human-robot interaction. During the half-day workshop, we will explore (1) the diverse application opportunities of sound in human-robot interaction, (2) strategies for designing sonic human-robot interactions, and (3) methodologies for the evaluation of robot sound. Workshop outcomes will be documented on a dedicated website and are planned to be collected in a special issue.
|
|
| 21. |
- Pelikan, Hannah, 1994-
(författare)
-
Transcribing human–robot interaction : methodological implications of participating machines
- 2024. - 1
-
Ingår i: Ethnomethodological conversation analysis in motion. - London : Routledge. - 9781003424888 ; , s. 42-62
-
Bokkapitel (refereegranskat)abstract
- Robots that can talk and move may turn from tools to potential participants, which poses new methodological challenges, particularly for transcription. This chapter first presents best practices for transcribing multimodal robot actions, focusing on sound. Robots animate the action repertoires that they are given by their designers and can do so again and again, producing virtually identical sequences. This work discusses how to transcribe such repeated action, balancing between the general script and situated moves. Moving from transcription to analysis, the chapter pays special attention to differences in how humans and robots demonstrate understanding of sequential actions. The chapter closes by demonstrating how transcription can reveal the dynamic character of robot participation, which is often assisted and scaffolded by humans who frame the robot's actions as relevant and accountable.
|
|
| 22. |
- Pelikan, Hannah, 1994-, et al.
(författare)
-
When a Robot Comes to Life : The Interactional Achievement of Agency as a Transient Phenomenon
- 2022
-
Ingår i: Social Interaction. Video-Based Studies of Human Sociality. - : Koebenhavns Universitet * Institut for Nordiske Studier og Sprogvidenskab,Unversity of Copenhagen, Department of Scandinavian Studies and Linguistics. - 2446-3620. ; 5:3
-
Tidskriftsartikel (refereegranskat)abstract
- Conceptualizing agency is a long-standing theoretical concern. Taking an ethnomethodological and conversation analytic perspective, we explore agency as the oriented to capacity to produce situationally and sequentially relevant action. Drawing on video recordings of families interacting with the Cozmo toy robot, we present a multimodal analysis of a single episode featuring a variety of rapidly interchanging forms of robotic (non-)agency. We demonstrate how agency is ongoingly constituted in situated interaction between humans and a robot. Describing different ways in which the robot’s statuses as either an agent or an object are interactionally embodied into being, we distinguish “autonomous” agency, hybrid agency, ascribed agency, potential agency and non-agency.
|
|
| 23. |
- Pelikan, Hannah, 1994-
(författare)
-
Why Autonomous Driving Is So Hard : The Social Dimension of Traffic
- 2021
-
Ingår i: ACM/IEEE International Conference on Human-Robot Interaction (HRI). - New York, NY, USA : IEEE Computer Society. - 9781450382908 ; , s. 81-85
-
Konferensbidrag (refereegranskat)abstract
- Smooth traffic presupposes fine coordination between different actors, such as pedestrians, cyclists and car drivers. When autonomous vehicles join regular traffic, they need to coordinate with humans on the road. Prior work has often studied and designed for interaction with autonomous vehicles in structured environments such as traffic intersections. This paper describes aspects of coordination also in less structured situations during mundane maneuvers such as overtaking. Taking an ethnomethodological and conversation analytic approach, the paper analyzes video recordings of self-driving shuttle buses in Sweden. Initial findings suggest that the shuttle buses currently do not comply with cyclists’ expectations of social coordination in traffic. The paper highlights that communication and coordination with human road users is crucial for smooth flow of traffic and successful deployment of autonomous vehicles also in less structured traffic environments.
|
|
| 24. |
|
|
| 25. |
|
|
