| 1. |
- Shafiq, ur Réhman, 1978-, et al.
(författare)
-
Using Vibrotactile Language for Multimodal Human Animals Communication and Interaction
- 2014
-
Ingår i: Proceedings of the 2014 Workshops on Advances in Computer Entertainment Conference, ACE '14. - New York, NY, USA : Association for Computing Machinery (ACM). - 9781450333146 ; , s. 1:1-1:5
-
Konferensbidrag (refereegranskat)abstract
- In this work we aim to facilitate computer mediated multimodal communication and interaction between human and animal based on vibrotactile stimuli. To study and influence the behavior of animals, usually researchers use 2D/3D visual stimuli. However we use vibrotactile pattern based language which provides the opportunity to communicate and interact with animals. We have performed experiment with a vibrotactile based human-animal multimodal communication system to study the effectiveness of vibratory stimuli applied to the animal skin along with audio and visual stimuli. The preliminary results are encouraging and indicate that low-resolution tactual displays are effective in transmitting information.
|
|
| 2. |
- Amundin, Mats, et al.
(författare)
-
A proposal to use distributional models to analyse dolphin vocalisation
- 2017
-
Ingår i: Proceedings of the 1st International Workshop on Vocal Interactivity in-and-between Humans, Animals and Robots, VIHAR 2017. - 9782956202905 ; , s. 31-32
-
Konferensbidrag (refereegranskat)abstract
- This paper gives a brief introduction to the starting points of an experimental project to study dolphin communicative behaviour using distributional semantics, with methods implemented for the large scale study of human language.
|
|
| 3. |
- Frid, Emma, 1988-, et al.
(författare)
-
Perceptual Evaluation of Blended Sonification of Mechanical Robot Sounds Produced by Emotionally Expressive Gestures : Augmenting Consequential Sounds to Improve Non-verbal Robot Communication
- 2021
-
Ingår i: International Journal of Social Robotics. - : Springer Nature. - 1875-4791 .- 1875-4805.
-
Tidskriftsartikel (refereegranskat)abstract
- This paper presents two experiments focusing on perception of mechanical sounds produced by expressive robot movement and blended sonifications thereof. In the first experiment, 31 participants evaluated emotions conveyed by robot sounds through free-form text descriptions. The sounds were inherently produced by the movements of a NAO robot and were not specifically designed for communicative purposes. Results suggested no strong coupling between the emotional expression of gestures and how sounds inherent to these movements were perceived by listeners; joyful gestures did not necessarily result in joyful sounds. A word that reoccurred in text descriptions of all sounds, regardless of the nature of the expressive gesture, was “stress”. In the second experiment, blended sonification was used to enhance and further clarify the emotional expression of the robot sounds evaluated in the first experiment. Analysis of quantitative ratings of 30 participants revealed that the blended sonification successfully contributed to enhancement of the emotional message for sound models designed to convey frustration and joy. Our findings suggest that blended sonification guided by perceptual research on emotion in speech and music can successfully improve communication of emotions through robot sounds in auditory-only conditions.
|
|
| 4. |
- Frid, Emma, 1988-
(författare)
-
Musical Robots : Overview and Methods for Evaluation
- 2023
-
Ingår i: Sound and Robotics. - Boca Raton, FL, USA : Informa UK Limited. ; , s. 1-42
-
Bokkapitel (refereegranskat)abstract
- Musical robots are complex systems that require the integration of several different functions to successfully operate. These processes range from sound analysis and music representation to mapping and modeling of musical expression. Recent advancements in Computational Creativity (CC) and Artificial Intelligence (AI) have added yet another level of complexity to these settings, with aspects of Human–AI Interaction (HAI) becoming increasingly important. The rise of intelligent music systems raises questions not only about the evaluation of Human-Robot Interaction (HRI) in robot musicianship but also about the quality of the generated musical output. The topic of evaluation has been extensively discussed and debated in the fields of Human–Computer Interaction (HCI) and New Interfaces for Musical Expression (NIME) throughout the years. However, interactions with robots often have a strong social or emotional component, and the experience of interacting with a robot is therefore somewhat different from that of interacting with other technologies. Since musical robots produce creative output, topics such as creative agency and what is meant by the term "success" when interacting with an intelligent music system should also be considered. The evaluation of musical robots thus expands beyond traditional evaluation concepts such as usability and user experience. To explore which evaluation methodologies might be appropriate for musical robots, this chapter first presents a brief introduction to the field of research dedicated to robotic musicianship, followed by an overview of evaluation methods used in the neighboring research fields of HCI, HRI, HAI, NIME, and CC. The chapter concludes with a review of evaluation methods used in robot musicianship literature and a discussion of prospects for future research.
|
|
| 5. |
- Latupeirissa, Adrian Benigno, et al.
(författare)
-
Sonic characteristics of robots in films
- 2019
-
Ingår i: Proceedings of the 16th Sound and Music Computing Conference. - Malaga, Spain. ; , s. 1-6
-
Konferensbidrag (refereegranskat)abstract
- Robots are increasingly becoming an integral part of our everyday life. Expectations on robots could be influenced by how robots are represented in science fiction films. We hypothesize that sonic interaction design for real-world robots may find inspiration from sound design of fictional robots. In this paper, we present an exploratory study focusing on sonic characteristics of robot sounds in films. We believe that findings from the current study could be of relevance for future robotic applications involving the communication of internal states through sounds, as well for sonification of expressive robot movements. Excerpts from five films were annotated and analysed using Long Time Average Spectrum (LTAS). As an overall observation, we found that robot sonic presence is highly related to the physical appearance of robots. Preliminary results show that most of the robots analysed in this study have “metallic” voice qualities, matching the material of their physical form. Characteristics of robot voices show significant differences compared to voices of human characters; fundamental frequency of robotic voices is either shifted to higher or lower values, and the voices span over a broader frequency band.
|
|
| 6. |
- Schötz, Susanne, et al.
(författare)
-
Phonetic Characteristics of Domestic Cat Vocalisations
- 2017
-
Ingår i: Proceedings of the 1st International Workshop on Vocal Interactivity in-and-between Humans, Animals and Robots, VIHAR 2017. - 9782956202905 ; , s. 5-6
-
Konferensbidrag (refereegranskat)abstract
- The cat (Felis catus, Linneaus 1758) has lived around or with humans for at least 10,000 years, and is now one of the most popular pets of the world with more than 600 millionindividuals. Domestic cats have developed a more extensive, variable and complex vocal repertoire than most other members of the Carnivora, which may be explained by their social organisation, their nocturnal activity and the long period of association between mother and young. Still, we know surprisingly little about the phonetic characteristics of these sounds, and about the interaction between cats and humans.Members of the research project Melody in human–cat communication (Meowsic) investigate the prosodic characteristics of cat vocalisations as well as the communication between human and cat. The first step includes a categorisation of cat vocalisations. In the next step it will be investigated how humans perceive the vocal signals of domestic cats. This paper presents an outline of the project which has only recently started.
|
|
| 7. |
- Frid, Emma, et al.
(författare)
-
Haptic feedback combined with movement sonification using a friction sound improves task performance in a virtual throwing task
- 2018
-
Ingår i: Journal on Multimodal User Interfaces. - : Springer. - 1783-7677 .- 1783-8738. ; 13:4, s. 279-290
-
Tidskriftsartikel (refereegranskat)abstract
- In this paper we present a study on the effects of auditory- and haptic feedback in a virtual throwing task performed with a point-based haptic device. The main research objective was to investigate if and how task performance and perceived intuitiveness is affected when interactive sonification and/or haptic feedback is used to provide real-time feedback about a movement performed in a 3D virtual environment. Emphasis was put on task solving efficiency and subjective accounts of participants’ experiences of the multimodal interaction in different conditions. The experiment used a within-subjects design in which the participants solved the same task in different conditions: visual-only, visuohaptic, audiovisual and audiovisuohaptic. Two different sound models were implemented and compared. Significantly lower error rates were obtained in the audiovisuohaptic condition involving movement sonification based on a physical model of friction, compared to the visual-only condition. Moreover, a significant increase in perceived intuitiveness was observed for most conditions involving haptic and/or auditory feedback, compared to the visual-only condition. The main finding of this study is that multimodal feedback can not only improve perceived intuitiveness of an interface but that certain combinations of haptic feedback and movement sonification can also contribute with performance-enhancing properties. This highlights the importance of carefully designing feedback combinations for interactive applications.
|
|
| 8. |
- Paloranta, Jimmie, et al.
(författare)
-
Interaction with a large sized augmented string instrument intended for a public setting
- 2016
-
Ingår i: Sound and Music Computing 2016. - Hamburg : Zentrum für Mikrotonale Musik und Multimediale Komposition (ZM4). - 9783000537004 ; , s. 388-395
-
Konferensbidrag (refereegranskat)abstract
- In this paper we present a study of the interaction with a large sized string instrument intended for a large installation in a museum, with focus on encouraging creativity,learning, and providing engaging user experiences. In the study, nine participants were video recorded while interacting with the string on their own, followed by an interview focusing on their experiences, creativity, and the functionality of the string. In line with previous research, our results highlight the importance of designing for different levels of engagement (exploration, experimentation, challenge). However, results additionally show that these levels need to consider the users age and musical background as these profoundly affect the way the user plays with and experiences the string.
|
|
| 9. |
- Nielsen, Stig Anton, 1981, et al.
(författare)
-
Propositional Architecture using Induced Representation
- 2014
-
Ingår i: What’s the Matter? Materiality and Materialism at the Age of Computation. - 9789608932067 ; , s. 297-312
-
Konferensbidrag (refereegranskat)abstract
- The paper describes a method and an approach to using sensor data, machine-learning and pattern recognition for proposing and guiding immediate modifications to the existing built environment. The proposed method; Induced Representation, consists of a few steps which we have identified as crucial for such an approach. The steps are A: data collection from the environment, B: machine cognition, learning, prediction, and, c: proposition, visualization, and embodied representations for quick implementation. In the paper we outline the factual and theoretical basis for this approach, and we present and discuss three experiments that each deal with the steps A, B and C.
|
|
| 10. |
- Khan, Muhammad Sikandar Lal, 1988-, et al.
(författare)
-
Embodied tele-presence system (ETS) : Designing tele-presence for video teleconferencing
- 2014
-
Ingår i: 3rd International Conference on Design, User Experience, and Usability: User Experience Design for Diverse Interaction Platforms and Environments, DUXU 2014, Held as Part of 16th International Conference on Human-Computer Interaction, HCI Int. 2014. - Cham : Springer International Publishing. - 9783319076256 - 9783319076263 ; , s. 574-585
-
Konferensbidrag (refereegranskat)abstract
- In spite of the progress made in tele conferencing over the last decades, however, it is still far from a resolved issue. In this work, we present an intuitive video teleconferencing system, namely - Embodied Tele-Presence System (ETS) which is based on embodied interaction concept. This work proposes the results of a user study considering the hypothesis: " Embodied interaction based video conferencing system performs better than the standard video conferencing system in representing nonverbal behaviors, thus creating a 'feeling of presence' of a remote person among his/her local collaborators". Our ETS integrates standard audio-video conferencing with mechanical embodiment of head gestures of a remote person (as nonverbal behavior) to enhance the level of interaction. To highlight the technical challenges and design principles behind such tele-presence systems, we have also performed a system evaluation which shows the accuracy and efficiency of our ETS design. The paper further provides an overview of our case study and an analysis of our user evaluation. The user study shows that the proposed embodied interaction approach in video teleconferencing increases 'in-meeting interaction' and enhance a 'feeling of presence' among remote participant and his collaborators.
|
|
