| 1. |
- Jerčić, Petar
(author)
-
The Effects of Emotions and Their Regulation on Decision-making Performance in Affective Serious Games
- 2019
-
Doctoral thesis (other academic/artistic)abstract
- Emotions are thought to be one of the key factors that critically influence human decision-making. Emotion-regulation can help to mitigate emotion-related decision biases and eventually lead to a better decision performance. Serious games emerged as a new angle introducing technological methods to practicing emotion-regulation, where meaningful biofeedback information communicates player's affective states to a series of informed gameplay choices. These findings motivate the notion that in the decision context of serious games, one would benefit from awareness and regulation of such emerging emotions.This thesis explores the design and evaluation methods for creating serious games where emotion-regulation can be practiced using physiological biofeedback measures. Furthermore, it investigates emotions and the effect of emotion-regulation on decision performance in serious games. Using the psychophysiological methods in the design of such games, emotions and their underlying neural mechanism have been explored.The results showed the benefits of practicing emotion-regulation in serious games, where decision-making performance was increased for the individuals who down-regulated high levels of arousal while having an experience of positive valence. Moreover, it increased also for the individuals who received the necessary biofeedback information. The results also suggested that emotion-regulation strategies (i.e., cognitive reappraisal) are highly dependent on the serious game context. Therefore, the reappraisal strategy was shown to benefit the decision-making tasks investigated in this thesis. The results further suggested that using psychophysiological methods in emotionally arousing serious games, the interplay between sympathetic and parasympathetic pathways could be mapped through the underlying emotions which activate those two pathways. Following this conjecture, the results identified the optimal arousal level for increased performance of an individual on a decision-making task, by carefully balancing the activation of those two pathways. The investigations also validated these findings in the collaborative serious game context, where the robot collaborators were found to elicit diverse affect in their human partners, influencing performance on a decision-making task. Furthermore, the evidence suggested that arousal is equally or more important than valence for the decision-making performance, but once optimal arousal has been reached, a further increase in performance may be achieved by regulating valence. Furthermore, the results showed that serious games designed in this thesis elicited high physiological arousal and positive valence. This makes them suitable as research platforms for the investigation of how these emotions influence the activation of sympathetic and parasympathetic pathways and influence performance on a decision-making task.Taking these findings into consideration, the serious games designed in this thesis allowed for the training of cognitive reappraisal emotion-regulation strategy on the decision-making tasks. This thesis suggests that using evaluated design and development methods, it is possible to design and develop serious games that provide a helpful environment where individuals could practice emotion-regulation through raising awareness of emotions, and subsequently improve their decision-making performance.
|
|
| 2. |
- Chu, Thi My Chinh, et al.
(author)
-
Analysis of Variance of Opinion Scores for MPEG-4 Scalable and Advanced Video Coding
- 2018
-
In: 2018 12TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION SYSTEMS (ICSPCS). - : IEEE. - 9781538656020
-
Conference paper (peer-reviewed)abstract
- In this paper, we conduct an analysis of variance (ANOVA) on opinion scores for MPEG-4 scalable video coding (SVC) and advanced video coding (AVC) standards. This work resorts on a publicly available database providing opinion scores from subjective experiments for several scenarios such as different bit rates and resolutions. In particular, ANOVA is used for statistical hypothesis testing to compare two or more sets of opinion scores instead of being constrained to pairs of sets of opinion scores as would be the case for t-tests. As the ANOVA tests of the different scenarios are performed for mean opinion scores (MOS), box plots are also provided in order to assess the distribution of the opinion scores around the median. It is shown that the opinion scores given to the reference videos in SVC and AVC for different resolutions are statistically significantly similar regardless of the content. Further, for the opinion scores of the considered database, the ANOVA tests support the hypothesis that AVC generally outperforms SVC although the performance difference may be less pronounced for higher bit rates. This work also shows that additional insights on the results of subjective experiments can be obtained by extending the analysis of opinion scores beyond MOS to ANOVA tests and box plots.
|
|
| 3. |
- Elwardy, Majed, et al.
(author)
-
Annotated 360-Degree Image and Video Databases : A Comprehensive Survey
- 2019
-
In: 13th International Conference on Signal Processing and Communication Systems, ICSPCS 2019 - Proceedings. - : Institute of Electrical and Electronics Engineers Inc.. - 9781728121949
-
Conference paper (peer-reviewed)abstract
- The advances in 5G mobile networks are expected to enable immersive interconnected mobile multimedia systems. As humans are the final judges of the quality of immersive multimedia, it is essential to engage a suitable ground truth in the design of such systems. Databases annotated with results from subjective tests constitute such ground truth given as opinion scores, head movements, eye tracking data, psychophysiological data, and other data related to the viewers' behavior. On this basis, perception-based quality assessment of algorithms, systems, and services can be performed, and objective perceptual quality models can be developed. In this paper, a comprehensive survey of publicly available annotated 360-degree image and video databases is provided. The survey may guide the selection of ground truth on 360-degree images and videos to support quality assessment and modeling research. Further, the survey reveals the need for establishing new annotated databases that address the full range of subjective aspects of immersive multimedia. © 2019 IEEE.
|
|
| 4. |
- Elwardy, Majed, et al.
(author)
-
Comparison of ACR Methods for 360° Video Quality Assessment Subject to Participants' Experience with Immersive Media
- 2020
-
In: 2020 14th International Conference on Signal Processing and Communication Systems, ICSPCS 2020 - Proceedings. - : Institute of Electrical and Electronics Engineers Inc.. - 9781728199726
-
Conference paper (peer-reviewed)abstract
- Watching 360° videos on head-mounted displays (HMDs) has become more popular in recent years. As such, subjective quality assessment of 360° videos on HMDs is needed to obtain a ground truth on the quality as perceived by users. Due to the lack of standardized methods, the absolute category rating (ACR) with hidden reference (ACR-HR) method for conventional videos has also been used for subjective quality assessment of 360° videos on HMDs. A modified ACR (M-ACR) method tailored for assessing 360° videos on HMDs has recently been proposed. In this paper, we compare the ACR-HR and M-ACR with hidden reference (M-ACR-HR) method regarding subjective quality assessment of 360° videos on HMDs. The comparison is conducted subject to participants' experience with watching immersive media on HMDs. The findings include: 1) Average rating times to cast opinion scores is lower for the ACR-HR method irrespective of participants' experience, 2) Mean opinion scores are similar for both methods irrespective of participants' experience, 3) The M-ACR-HR method is more reliable, especially with experts and participants with no experience, 4) Discomfort is significantly lower for the ACR-HR method, especially, for participants with no experience. © 2020 IEEE.
|
|
| 5. |
- Elwardy, Majed, et al.
(author)
-
Evaluation of Simulator Sickness for 360 degrees Videos on an HMD Subject to Participants' Experience with Virtual Reality
- 2020
-
In: IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES WORKSHOPS (VRW 2020). - : Institute of Electrical and Electronics Engineers Inc.. - 9781728165325 ; , s. 477-484
-
Conference paper (peer-reviewed)abstract
- Virtual reality (VR) has seen tremendous advances in head-mounted displays (HMDs), optics, media quality, and other improvements that facilitate immersive experiences. With the occurrence of new technologies like Cloud VR and networked VR video services, applications such as 360° video streaming are becoming more popular within the broader consumer markets. As a result, VR content is accessible to customers with rather different levels of experiences with immersive media, i.e., never, sometimes, or often use of VR. The question, therefore, arises to which degree simulator sickness is induced to viewers depending on their experiences with VR on HMDs. In this paper, simulator sickness is evaluated for 360° videos that were shown on an HTC Vive Pro HMD to participants having different levels of experience with VR on HMDs. The modified absolute category rating with hidden reference (M-ACR-HR) method was used in a subjective experiment for video quality assessment within two subsequent sessions along with a simulator sickness questionnaire (SSQ). A statistical analysis of the SSQ scores is performed to reveal the relationship between simulator sickness and participants' experiences with VR regarding: (1) Individual symptoms, (2) Pairwise comparison of symptoms, and (3) Symptom clusters of nausea, oculomotor, disorientation, and total score. It is shown that the simulator sickness symptoms, in general, are slightly or rarely perceived across the different experience levels for the selected 360° videos. The results indicate that the reported simulator sickness increases in the second session for participants that never used VR on HMDs. Sufficiently long breaks between sessions should therefore be accounted for in the M-ACR-HR method to avoid that simulator sickness influences quality rating. © 2020 IEEE.
|
|
| 6. |
- Elwardy, Majed, 1988-, et al.
(author)
-
Impact of Participants' Experiences with Immersive Multimedia on 360 degrees Video Quality Assessment
- 2019
-
In: 13th International Conference on Signal Processing and Communication Systems, ICSPCS 2019 - Proceedings. - : Institute of Electrical and Electronics Engineers Inc.. - 9781728121949
-
Conference paper (peer-reviewed)abstract
- In this paper, we study the impact that the level of experience of participants with immersive multimedia has on 360° video quality assessment. An extensive subjective experiment using the modified absolute category rating with hidden reference (M-ACR-HR) method was conducted. The opinion scores obtained from the participants in this experiment along with other sensor data support this study. The statistical analysis is performed in terms of screening participants' distribution of opinion scores for consistency, average rating time, box plots related to mean opinion scores (MOSs) and differential MOS (DMOS). Detailed results for MOS and DMOS are also provided for reference and test sequences covering a wide range of qualities. Major findings include: (1) Screening detects many outliers for participants with no experience, (2) Average rating times show that experts learn the quality assessment task fast, (3) Participants with no experience provide lower opinion scores in average, (4) DMOS may alleviate the bias in quality rating caused by different levels of experience. © 2019 IEEE.
|
|
| 7. |
- Elwardy, Majed, et al.
(author)
-
Objective Perceptual Video Quality Prediction Using Spatial and Temporal Information Differences
- 2019
-
In: Proceedings - 2019 19th International Symposium on Communications and Information Technologies, ISCIT 2019. - : Institute of Electrical and Electronics Engineers Inc.. - 9781728150093 ; , s. 436-441
-
Conference paper (peer-reviewed)abstract
- In this paper, objective perceptual video quality models are proposed that use spatial and temporal perceptual information differences for predicting video quality as perceived by human observers. Spatial perceptual information characterizes the complexity and temporal perceptual information quantifies the motion contained in a video. As such, differences in the spatial and temporal perceptual information of a reference video (original) and test video (processed) may be used to predict quality of videos that have undergone encoding, transmission, or other processing. In particular, several video quality prediction functions are derived using curve fitting along with training and validation on data from a publicly available annotated database. The obtained functions provide predicted mean opinion scores as a measure of perceptual quality subject to spatial and temporal perceptual information differences. The analysis of the video quality prediction performance of the proposed models shows that differences in spatial and temporal perceptual information can be used for objective video quality prediction. © 2019 IEEE.
|
|
| 8. |
- Fu, Yu, et al.
(author)
-
A Review of Extended Reality Exercise Games for Elderly
- 2021
-
In: HEALTHINF: PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON BIOMEDICAL ENGINEERING SYSTEMS AND TECHNOLOGIES - VOL 5: HEALTHINF. - : SciTePress. - 9789897585524 ; , s. 201-210
-
Conference paper (peer-reviewed)abstract
- With the increasing of ageing all over the world, elderly health attracts more and more attention. This paper aims to study existing extended reality (XR) game applications for physical exercise through a literature review with 14 papers as an outcome. Based on these papers, we explored the contributions, opportunities, and challenges of exercise XR games for the elderly. The papers were analysed based on several perspectives, including publication information, design and implementation, game information, teamwork and social games, evaluation, and advantages and disadvantages. We found that the elderly were interested in and accepted the use of XR games. The positive effect of such games was common in the research results. Even if there were problems, such as simulator sickness, safety risks. device problems, and cost, there are still opportunities and space for research and development in the future. The overall positive attitudes toward XR exercise games for the elderly could be seen by both researchers, developers, and users. However, these game applications also presented some problems and future improvements are needed. The presented review is beneficial for researchers and developers to create or enhance future XR applications by learning from existing work.
|
|
| 9. |
- Fu, Yu, et al.
(author)
-
A Survey of Possibilities and Challenges with AR/VR/MR and Gamification Usage in Healthcare
- 2021
-
In: Proceedings of the 14th International Joint Conference on Biomedical Engineering Systems and Technologies - HEALTHINF. - : SciTePress. - 9789897584909 ; , s. 733-740
-
Conference paper (peer-reviewed)abstract
- Software and applications of augmented reality (AR), virtual reality (VR), and mixed reality (MR) technology combined with game/gamification techniques in healthcare have increasingly been studied in academia. However, there is a need to explore the usage, challenges and opportunities of AR/VR/MR game/gamification software/applications in the healthcare system. To explore this, we present an online survey conducted in the healthcare-relevant system (including hospital-based system, homecare-based system, institute and university, and industry). Based on the answers, we found examples of digital games and AR/VR/MR applications used in healthcare, as well as some general information (name and feature, purpose, target user, and use occasion), usage situation, and user experience. This presented survey is beneficial for both researchers and developers in computer science and medical science. It can familiarise them with existing products and their current use, advantages and potential issues of AR/VR/MR and game applications in healthcare. In future work, the survey would be extended to obtain other user experiences and feedback of AR/VR/MR techniques and game/gamification technology applied to healthcare, as well as to study how to overcome the challenges, and develop the opportunities further.
|
|
| 10. |
- Fu, Yu, et al.
(author)
-
A Systematic Literature Review of Virtual, Augmented, and Mixed Reality Game Applications in Healthcare
- 2022
-
In: ACM Transactions on Computing for Healthcare. - : ACM Publications. - 2691-1957 .- 2637-8051. ; 3:2
-
Research review (peer-reviewed)abstract
- Virtual reality, augmented reality, and mixed reality (VR/AR/MR) as information and communication technologies have been recognised and implemented in healthcare in recent years. One of the popular application ways is games, due to the potential benefits of providing an engaging and immersive experience in a virtual environment. This study presents a systematic literature review that evaluates the state-of-the-art on VR/AR/MR game applications in healthcare by collecting and analysing related journal and conference papers published from 2014 through to the first half of 2020. After retrieving more than 3,000 papers from six databases, 88 articles, from both computer science and medicine, were selected and analysed in the review. The articles are classified and summarised based on their (1) publication information, (2) design, implementation, and evaluation, and (3) application. The presented review is beneficial for both researchers and developers interested in exploring current research and future trends in VR/AR/MR in healthcare. © 2022 Association for Computing Machinery.
|
|
| 11. |
- Fu, Yu, et al.
(author)
-
A Systematic Literature Review of Extended Reality Exercise Games for the Elderly
- 2023
-
In: Biomedical Engineering Systems and Technologies. - : Springer Science+Business Media B.V.. - 9783031388538 ; , s. 333-352
-
Conference paper (peer-reviewed)abstract
- In recent years, with the rise of the ageing population worldwide, the health of the elderly has attracted increasing attention. This study explored existing extended reality (XR) game applications aiming at physical exercise for the elderly. Through the review of 1847 papers from the Scopus database, 17 articles were included. Based on these papers, we explored the existing contributions of exercise XR games for the elderly, the development opportunities and challenges of such games, and their special considerations in adapting to the characteristics and requirements of the target user. The results were organized into several perspectives: publication information and keywords, immersive technologies and game concepts, teamwork and social games, evaluation, opportunities and challenges, and adapting designs. We found the elderly interested in and accepted using XR games. The reported research results proved positive effects on such games’ physical and mental health. XR exercise games for the elderly should considerately adapt to the elder’s cognition, behaviour, and demand. Although problems existed, such as simulator sickness, safety risks, device problems, and cost, there were opportunities and space for research and future developments. Researchers and developers could refer to this paper for XR exercise games for the elderly and create or enhance future XR applications by learning from existing work. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.
|
|
| 12. |
- Fu, Yu, et al.
(author)
-
Conceptual Design of an Extended Reality Exercise Game for the Elderly
- 2022
-
In: Applied Sciences. - : MDPI. - 2076-3417. ; 12:13
-
Journal article (peer-reviewed)abstract
- Facing the increasingly serious ageing problem, IT technology is being applied more and more to alleviate the increasing health demands of the elderly. Virtual reality (VR) games, in particular, have been shown to benefit the physical and mental health of the elderly. However, almost all consumer-level VR games address the general user, not considering the characteristics of the elderly, such as their particular needs regarding cognitive aspects and safety. In addition, the existing VR rowing games’ research typically focuses on athlete training or is based on a rowing machine. Extending on previous research, this paper proposes a conceptual design of a VR rowing game, VRrowing to provide a home exercise game for the elderly which benefits both physical and mental health. This research first analysed the relevant literature and existing VR exercise games for the elderly to find characteristics and their particular needs. Then, following design principles (in exercise games, human–computer interaction, and user interfaces (UIs)) for the elderly, this study proposed a conceptual design of VRrowing through the MDA framework (standing for mechanics, dynamics, and aesthetics). The results cover the system architecture, activities and tasks, patterns and roles, mechanics and structures, and UI examples. Based on comprehensive consideration of the results from relevant research and fostering strengths and circumventing weaknesses, VRrowing was designed as a sports game, aimed at the elderly according to their characteristics and needs, which fills the void of home VR rowing games for seniors’ exercise. This research has reference value for scientific research or development personnel in VR game applications and evaluations, especially for such games targeting the elderly. © 2022 by the authors. Licensee MDPI, Basel, Switzerland.
|
|
| 13. |
- Garro, Valeria, 1983-, et al.
(author)
-
A review of current trends on visual perception studies in virtual and augmented reality
- 2020
-
In: SIGGRAPH Asia 2020 Courses, SA 2020. - New York, NY, USA : Association for Computing Machinery, Inc. - 9781450381123
-
Conference paper (peer-reviewed)abstract
- In the development of novel algorithms and techniques in virtual and augmented reality (VR/AR), it is crucial to take human visual perception into account. For example, when hardware resources are a restraining factor, the limitations of the human visual system can be exploited in the creation and evaluation of new effective techniques. Over the last decades, visual perception evaluation studies have become a vital part of the design, development, and evaluation of immersive computer graphics applications. This course aims at introducing the attendees to the basic concepts of visual perception applied to computer graphics and it offers an overview of recent perceptual evaluation studies that have been conducted with head-mounted displays (HMDs) in the context of VR and AR applications. During this course, we call attention to the latest published courses and surveys on visual perception applied to computer graphics and interaction techniques. Through an extensive search in the literature, we have identified six main areas in which recent visual perceptual evaluation studies have been focused on: Distance perception, avatar perception, image quality, interaction, motion perception, and cybersickness. Trends, main results, and open challenges are discussed for each area and accompanied with relevant references offering the attendees a wide introduction and perspective on the topic. © 2019 Owner/Author.
|
|
| 14. |
- Garro, Valeria, 1983-, et al.
(author)
-
Augmented Reality and 3D Printing for Archaeological Heritage : Evaluation of Visitor Experience
- 2022
-
In: Extended Reality. - Cham : Springer Science+Business Media B.V.. - 9783031155529 ; , s. 360-372
-
Conference paper (peer-reviewed)abstract
- Augmented Reality (AR) and 3D printing have increasingly been used in archaeological and cultural heritage to make artifacts and environments accessible to the general public. This paper presents the case study of the Ljungaviken dog, an archaeological find of dog skeleton remains dated around 8000 years ago. The dog remains have been digitized using 3D scanning and displayed in an AR application. A physical replica has also been created with 3D printing. Both the AR application and the 3D printed copy have been shown in a temporary museum exhibition. In this paper, we present the visitors’ experience evaluation based on a study with 42 participants. Aspects being evaluated are related to the realism, enjoyment, and easiness of use of the AR application. Moreover, the two media are compared in terms of understanding, visual quality, and experience satisfaction. The results show an overall positive experience for both the display solutions, with slightly higher scores for the AR application in the comparison. When asked about overall preference, the participants reported similar results between both media. Due to issues of displaying fragile objects in a museum setting, as well as recent restrictions following pandemic closures and availability, the results presented in this paper show a positive alternative towards using digital artifacts to showcase our cultural heritage. © 2022, Springer Nature Switzerland AG.
|
|
| 15. |
- Garro, Valeria, 1983-, et al.
(author)
-
Impact of Location, Gender and Previous Experience on User Evaluation of Augmented Reality in Cultural Heritage : The Mjallby Crucifix Case Study
- 2022
-
In: Heritage. - : MDPI. - 2571-9408. ; 5:3, s. 1988-2006
-
Journal article (peer-reviewed)abstract
- In recent decades, a growing number of museums have adopted digital media, both as an enhancement of exhibitions of real artifacts and as an alternative to traditional display methods. The digital acquisition of artifacts generates accurate 3D replicas that can be displayed via different digital media. With an increase in immersive technologies in the cultural heritage (CH) domain, it is common to see digital artifacts presented in Virtual Reality (VR) and Augmented Reality (AR). This paper presents two user studies conducted in different locations evaluating the use of an AR application in the portrayal of the Mjallby Crucifix artifact. This paper presents the overall results from both user studies evaluating and discussing the AR application on a number of different aspects on a 7-point Likert scale: (1) understanding the artifact, (2) ease of use, (3) object feeling part of reality, (4) perceived visual quality of the object, (5) overall satisfaction experience, and (6) willingness to download the AR application. The results have been compared between genders, age groups, and previous experience with AR. Potential benefits and disadvantages of AR experiences in the context of a museum exhibition were also gathered in free text from the visitors.
|
|
| 16. |
- Garro, Valeria, 1983-, et al.
(author)
-
Panoptic Visual Analytics of Eye Tracking Data
- 2022
-
In: PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (IVAPP), VOL 3. - : SciTePress. - 9789897585555 ; , s. 171-178
-
Conference paper (peer-reviewed)abstract
- In eye tracking data visualization, areas of interest (AOIs) are widely adopted to analyze specific regions of the stimulus. We propose a visual analytics tool that leverages panoptic segmentation to automatically divide the whole image or frame video in semantic AOIs. A set of AOI-based visualization techniques are available to analyze the fixation data based on these semantic AOIs. Moreover, we propose a modified version of radial transition graph visualizations adapted to the extracted semantic AOIs and a new visualization technique also based on radial transition graphs. Two application examples illustrate the potential of this approach and are used to discuss its usefulness and limitations.
|
|
| 17. |
- Garro, Valeria, 1983-, et al.
(author)
-
Pose and visual attention : Exploring the effects of 3D shape near-isometric deformations on gaze
- 2020
-
In: Computer Science Research Notes. - : Vaclav Skala Union Agency. ; , s. 153-160
-
Conference paper (peer-reviewed)abstract
- Recent research in 3D shape analysis focuses on the study of visual attention on rendered 3D shapes investigating the impact of different factors such as material, illumination, and camera movements. In this paper, we analyze how the pose of a deformable shape affects visual attention. We describe an eye-tracking experiment that studied the influence of different poses of non-rigid 3D shapes on visual attention. The subjects free-viewed a set of 3D shapes rendered in different poses and from different camera views. The fixation maps obtained by the aggregated gaze data were projected onto the 3D shapes and compared at vertex level. The results indicate an impact of the pose for some of the tested shapes and also that view variation influences visual attention. The qualitative analysis of the 3D fixation maps shows high visual focus on the facial regions regardless of the pose, coherent with previous works. The visual attention variation between poses appears to correspond to geometric salient features and semantically salient parts linked to the action represented by the pose. © 2020, Vaclav Skala Union Agency. All rights reserved.
|
|
| 18. |
- Hu, Yan, 1985-, et al.
(author)
-
A Review on XR in Home-based Nursing Education
- 2023
-
In: HEALTHINFO 2023. - : International Academy, Research, and Industry Association (IARIA). - 9781685581053 ; , s. 39-43
-
Conference paper (peer-reviewed)abstract
- Recent developments using extended reality (XR) technologies have allowed for increased use in healthcare in the last few years. This review paper explores how XR applications are utilized in home-based nursing education, in particular, to identify future challenges and opportunities. The systematic literature review evaluates relevant extracted papers based on publication information, XR technology used for education purposes, target users, and study design and evaluation, including sample size. The results show potential for using XR technologies in home-based nursing education. In particular, Virtual Reality (VR) has become quite popular and the most used to date. However, Augmented Reality (AR) has also emerged as an alternative for the future.
|
|
| 19. |
|
|
| 20. |
- Jerčić, Petar, et al.
(author)
-
Practicing Emotion-Regulation Through Biofeedback on the Decision-Making Performance in the Context of Serious Games : a Systematic Review
- 2019
-
In: Entertainment Computing. - : Elsevier. - 1875-9521 .- 1875-953X. ; 29, s. 75-86
-
Journal article (peer-reviewed)abstract
- Evidence shows that emotions critically influence human decision-making. Therefore, emotion-regulation using biofeedback has been extensively investigated. Nevertheless, serious games have emerged as a valuable tool for such investigations set in the decision-making context. This review sets out to investigate the scientific evidence regarding the effects of practicing emotion-regulation through biofeedback on the decision-making performance in the context of serious games. A systematic search of five electronic databases (Scopus, Web of Science, IEEE, PubMed Central, Science Direct), followed by the author and snowballing investigation, was conducted from a publication's year of inception to October 2018. The search identified 16 randomized controlled experiment/quasi-experiment studies that quantitatively assessed the performance on decision-making tasks in serious games, involving students, military, and brain-injured participants. It was found that the participants who raised awareness of emotions and increased the skill of emotion-regulation were able to successfully regulate their arousal, which resulted in better decision performance, reaction time, and attention scores on the decision-making tasks. It is suggested that serious games provide an effective platform validated through the evaluative and playtesting studies, that supports the acquisition of the emotion-regulation skill through the direct (visual) and indirect (gameplay) biofeedback presentation on decision-making tasks.
|
|
| 21. |
- Jerčić, Petar, et al.
(author)
-
The Effect of Emotions and Social Behavior on Performance in a Collaborative Serious Game Between Humans and Autonomous Robots
- 2018
-
In: International Journal of Social Robotics. - : Springer. - 1875-4791 .- 1875-4805. ; 10:1, s. 115-129
-
Journal article (peer-reviewed)abstract
- The aim of this paper is to investigate performance in a collaborative human–robot interaction on a shared serious game task. Furthermore, the effect of elicited emotions and perceived social behavior categories on players’ performance will be investigated. The participants collaboratively played a turn-taking version of the Tower of Hanoi serious game, together with the human and robot collaborators. The elicited emotions were analyzed in regards to the arousal and valence variables, computed from the Geneva Emotion Wheel questionnaire. Moreover, the perceived social behavior categories were obtained from analyzing and grouping replies to the Interactive Experiences and Trust and Respect questionnaires. It was found that the results did not show a statistically significant difference in participants’ performance between the human or robot collaborators. Moreover, all of the collaborators elicited similar emotions, where the human collaborator was perceived as more credible and socially present than the robot one. It is suggested that using robot collaborators might be as efficient as using human ones, in the context of serious game collaborative tasks.
|
|
| 22. |
- Kelkkanen, Viktor, 1991-
(author)
-
Evaluation and Reduction of Temporal Issues in Remote VR
- 2023
-
Doctoral thesis (other academic/artistic)abstract
- The aim of this thesis is to study and advance knowledge and technologies surrounding remote rendering of Virtual Reality (VR). In particular regarding temporal aspects such as latency and video stalling events. In remote rendering, rendered content is commonly streamed as video images in network packets from a server to a client. The main purpose is to be able to utilize the processing power available in stationary machines on thin clients that are otherwise limited by weight and size due to their mobility requirements. Achieving this process in real-time with excellent quality is not trivial in interactive VR due to the requirements on low latency and high visual fidelity. The dissertation brings to light the main challenges of the field as well as a set of new proposals and knowledge on the topic. As an introduction to the field, the dissertation begins with a study on 360-video streaming, which is a form of VR but less interactive. Moving on into real-time remote rendering, a commercial wireless VR adapter is studied and a method for monitoring its data traffic is proposed and implemented. The monitoring is able to provide a baseline in terms of video stalling events in a commercial remote-VR product. Moving on, a prototype remote renderer for VR is implemented using a proposed architecture, it is furthermore tested in various network conditions to determine under which conditions such remote rendering may be viable. Having constructed the remote renderer, a study is conducted that shows the effect of headset movements on the resulting video bitrate requirements in remote VR. Furthermore, a method that can reduce the codec image size in remote VR is proposed and its viability is tested with the prototype. Finally, two works are reported, in which human participants are involved, one for studying the subjective effects of video stalls in VR and one for studying the objective effects of hand-controller latency on aiming accuracy in VR.
|
|
| 23. |
- Luro, Francisco Lopez, et al.
(author)
-
A comparative study of eye tracking and hand controller for aiming tasks in virtual reality
- 2019
-
In: Eye Tracking Research and Applications Symposium (ETRA). - New York, NY, USA : Association for Computing Machinery. - 9781450367097
-
Conference paper (peer-reviewed)abstract
- Aiming is key for virtual reality (VR) interaction, and it is often done using VR controllers. Recent eye-tracking integrations in commercial VR head-mounted displays (HMDs) call for further research on usability and performance aspects to better determine possibilities and limitations. This paper presents a user study exploring gaze aiming in VR compared to a traditional controller in an “aim and shoot” task. Different speeds of targets and trajectories were studied. Qualitative data was gathered using the system usability scale (SUS) and cognitive load (NASA TLX) questionnaires. Results show a lower perceived cognitive load using gaze aiming and on par usability scale. Gaze aiming produced on par task duration but lower accuracy on most conditions. Lastly, the trajectory of the target significantly affected the orientation of the HMD in relation to the target’s location. The results show potential using gaze aiming in VR and motivate further research. © 2019 Copyright held by the owner/author(s). Publication rights licensed to ACM.
|
|
| 24. |
- Luro, Francisco Lopez, et al.
(author)
-
Ethical considerations for the use of virtual reality : An evaluation of practices in academia and industry
- 2017
-
In: Proceedings of the 27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments. - : ACM Digital Library. ; , s. 141-148
-
Conference paper (peer-reviewed)abstract
- The following article offers a set of recommendations that are considered relevant for designing and executing experiences with Virtual Reality (VR) technology. It presents a brief review of the history and evolution of VR, along with the physiological issues related to its use. Additionally, typical practices in VR, used by both academia and industry are discussed and contrasted. These were further analysed from an ethical perspective, guided by legal and Corporate Social Responsibility (CSR) frameworks, to understand their motivation and goals, and the rights and responsibilities related to the exposure of research participants and final consumers to VR. Our results showed that there is a significant disparity between practices in academia and industry, and for industry specifically, there can be breaches of user protection regulations and poor ethical practices. The differences found are mainly in regards to the type of content presented, the overall setup of VR experiences, and the amount of information provided to participants or consumers respectively. To contribute to this issue, this study highlights some ethical aspects and also offers practical considerations that aim, not only to have more appropriate practices with VR in public spaces but also to motivate a discussion and reflection to ease the adoption of this technology in the consumer market.
|
|
| 25. |
- Napieralla, Jonah, et al.
(author)
-
Ultrawide field of view by curvilinear projection methods
- 2020
-
In: Journal of WSCG. - : Vaclav Skala Union Agency. - 1213-6972 .- 1213-6964. ; 28:1-2, s. 163-167
-
Journal article (peer-reviewed)abstract
- The rectilinear Perspective projection produces natural-looking results on the condition that the degree of field of view (FoV) is narrow, as raising it causes an exponential increase in visual distortion. Curvilinear perspective projection methods that counter this issue exist in photography, but unlike the rectilinear Perspective projection, these are neither used nor technically documented in computer graphics. This paper contributes by presenting results from a perceptual experiment comparing the rectilinear Perspective projection method to the curvilinear Panini and Stereographic projection methods. These are commonly used with wide-angle lenses in photography and have been digitally recreated for use in computer graphics. The experiment shows a clear preference for the two curvilinear projection methods at high degrees of FoV, as not a single participant prefers the rectilinear Perspective projection at degrees of FoV approaching the human breadth of vision. © 2020, Vaclav Skala Union Agency. All rights reserved.
|
|
| 26. |
- Navarro, Diego, et al.
(author)
-
Biofeedback Methods in Entertainment Games and Virtual Reality : A Review of Physiological Interaction Techniques
-
Other publication (other academic/artistic)abstract
- The area of biofeedback interaction has grown over recent years, thanks to the release of affordable and reliable sensor technology, and the accessibility offered by modern game development tools. This article reviews how different biofeedback interaction methods have been used for entertainment purposes in video games and virtual reality, between the years 2008 and 2020. It divides previous contributions in terms of a proposed interaction classification criteria and six different biofeedback methods: electroencephalography, electrocardiography, eye tracking, electrodermal activity, electromyography, and multi-modal interaction respectively. The review describes the properties, sensor technology, and the type of data gathered for every included biofeedback method, and summarizes their respective interaction techniques into tables. Also, it proposes a set of opportunities and challenges for both, each included method and the area as a whole, based on the results from previous publications.
|
|
| 27. |
- Navarro, Diego, et al.
(author)
-
Biofeedback Methods in Entertainment Video Games : A Review of Physiological Interaction Techniques
- 2021
-
In: Proceedings of the ACM on Human-Computer Interaction. - : Association for Computing Machinery. - 2573-0142. ; 5:CHIPLAY
-
Journal article (peer-reviewed)abstract
- The area of biofeedback interaction has grown over recent years, thanks to the release of more affordable and reliable sensor technology, and the accessibility offered by modern game development tools. This article presents a systematic literature review focusing on how different biofeedback interaction methods have been used for entertainment purposes in video games, between 2008 and 2020. It divides previous contributions in terms of a proposed interaction classification criteria and five different biofeedback methods (with a sixth category combining them): electroencephalography, electrocardiography, eye tracking, electrodermal activity, electromyography, and multi-modal interaction. The review describes the properties, sensor technologies, and the type of data gathered for every included biofeedback method, and presents their respective interaction techniques. It summarizes a set of opportunities and challenges for each included method, based on the results from previous work, and discusses these findings. It also analyzes how these interaction techniques are distributed between different common game genres. The review is beneficial for people interested in biofeedback methods and their potential use for novel interaction techniques in future video games. © 2021 ACM.
|
|
| 28. |
- Navarro, Diego, et al.
(author)
-
Electrodermal Activity Evaluation of Player Experience in Virtual Reality Games : A Phasic Component Analysis
- 2022
-
In: PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (HUCAPP), VOL 2. - : SciTePress. - 9789897585555 ; , s. 108-116
-
Conference paper (peer-reviewed)abstract
- Electrodermal activity (EDA) is considered to be an effective metric for measuring changes in the arousal level of people. In this paper, the phasic component of EDA data from players is analyzed in relation to their reported experience from a standardized questionnaire, when interacting with a couple of virtual reality games that featured two different input devices: the HTC Vive and Leap Motion controllers. Initial results show that there are no significant differences in the phasic component data, despite having significant differences in their respective player experience. Furthermore, no linear correlations are found between the phasic component data and the evaluated experience variables, with the only exception of negative affect which features a weak positive correlation. In conclusion, the phasic component of EDA data has here shown a limited correlation with player experience and should be further explored in combination with other psychophysiological signals.
|
|
| 29. |
- Navarro, Diego, et al.
(author)
-
Evaluating player performance and experience in virtual reality game interactions using the htc vive controller and leap motion sensor
- 2019
-
In: VISIGRAPP 2019 - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications. - : SciTePress. - 9789897583544 ; , s. 103-110
-
Conference paper (peer-reviewed)abstract
- An important aspect of virtual reality (VR) interfaces are novel natural user interactions (NUIs). The increased use of VR games requires the evaluation of novel interaction techniques that allow efficient manipulations of 3D elements using the hands of the player. Examples of VR devices that support these interactions include the HTC Vive controller and the Leap Motion sensor. This paper presents a quantitative and qualitative evaluation of player performance and experience in a controlled experiment with 20 volunteering participants. The experiment evaluated the HTC Vive controller and the Leap Motion sensor when manipulating 3D objects in two VR games. The first game was a Pentomino puzzle and the second game consisted of a ball-throwing task. Four interaction techniques (picking up, dropping, rotating, and throwing objects) were evaluated as part of the experiment. The number of user interactions with the Pentomino pieces, the number of ball throws, and game completion time were metrics used to analyze the player performance. A questionnaire was also used to evaluate the player experience regarding enjoyment, ease of use, sense of control and user preference. The overall results show that there was a significant decrease in player performance when using the Leap Motion sensor for the VR game tasks. Participants also reported that hand gestures with the Leap Motion sensor were not as reliable as the HTC Vive controller. However, the survey showed positive responses when using both technologies. The paper also offers ideas to keep exploring the capabilities of NUI techniques in the future. Copyright © 2019 by SCITEPRESS – Science and Technology Publications, Lda. All rights reserved
|
|
| 30. |
|
|
| 31. |
- Navarro, Diego, et al.
(author)
-
The Electrodermal Activity of Player Experience in Virtual Reality Games : An Extended Evaluation of the Phasic Component
- 2023
-
In: Computer Vision, Imaging and Computer Graphics Theory and Applications. - : Springer Science+Business Media B.V.. - 9783031457241 ; , s. 203-221
-
Conference paper (peer-reviewed)abstract
- Thanks to its effectiveness, electrodermal activity (EDA) has been previously included as an evaluation metric, within analyses of user experience. In this study, the phasic component of participants’ EDA data is examined in relation to their reported experiences when playing a set of virtual reality games, that featured the HTC Vive and Leap Motion controllers for input. Two models are used in the analysis of the phasic component: a deconvolution model and a convex optimization model. Despite having significant differences in their player experiences, results indicate that there are not many significant differences in the phasic component data. Even if some weak correlations were found, the majority of results show no linear correlations between the phasic component data and the reported experience variables. This shows that the phasic component of EDA data should be further investigated in conjunction with other psychophysiological signals because it has only recently demonstrated a weak link with player experience. © 2023, The Author(s), under exclusive license to Springer Nature Switzerland AG.
|
|
| 32. |
- Pettersson, Erik, et al.
(author)
-
A Perceptual Evaluation of Social Interaction with Emotes and Real-time Facial Motion Capture
- 2017
-
In: MIG'17: PROCEEDINGS OF THE TENTH INTERNATIONAL CONFERENCE ON MOTION IN GAMES. - : ACM Publications.
-
Conference paper (peer-reviewed)abstract
- Social interaction between players is an important feature in online games, where text- and voice chat is a standard way to communicate.To express emotions players can type emotes which are text-based commands to play animations from the player avatar. This paper presents a perceptual evaluation which investigates if instead expressing emotions with the face, in real-time with a web camera, is perceived more realistic and preferred in comparison to typing emote-based text commands. A user study with 24 participants was conducted where the two methods to express emotions described above were evaluated. For both methods the participants ranked the realism of facial expressions, which were based on the theory of seven universal emotions stated by American psychologist Paul Ekman: happiness, anger, fear, sadness, disgust, surprise and contempt.The participants also ranked their perceived efficiency of performing the two methods and selected the method they preferred. A significant difference was shown when analyzing the results of ranked facial expression realism. Happiness was perceived as the most realistic in both methods, while disgust and sadness were poorly rated when performed with the face. One conclusion of the perceptual evaluation was that the realism and preference between the methods showed no significant differences. However, participants had higher performance in typing with emotes. Real-time facial capture technology also needs improvements to obtain better recognition and tracking of facial features in the human face.
|
|
| 33. |
- Santos, Beatriz Sousa, et al.
(author)
-
Distinctive Approaches to Computer Graphics Education
- 2018
-
In: Computer graphics forum (Print). - : Blackwell Publishing Ltd. - 0167-7055 .- 1467-8659. ; 7:1, s. 403-412
-
Journal article (peer-reviewed)abstract
- This paper presents the latest advances and research in Computer Graphics education in a nutshell. It is concerned with topics that were presented at the Education Track of the Eurographics Conference held in Lisbon in 2016. We describe works corresponding to approaches to Computer Graphics education that are unconventional in some way and attempt to tackle unsolved problems and challenges regarding the role of arts in computer graphics education, the role of research-oriented activities in undergraduate education and the interaction among different areas of Computer Graphics, as well as their application to courses or extra-curricular activities. We present related works addressing these topics and report experiences, successes and issues in implementing the approaches. © 2017 The Eurographics Association and John Wiley & Sons Ltd.
|
|
| 34. |
- Sundstedt, Veronica, 1979-, et al.
(author)
-
A Systematic Review of Visualization Techniques and Analysis Tools for Eye-Tracking in 3D Environments
- 2022
-
In: FRONTIERS IN NEUROERGONOMICS. - : Frontiers Media S.A.. - 2673-6195. ; 3
-
Research review (peer-reviewed)abstract
- This systematic literature review presents an update on developments in 3D visualization techniques and analysis tools for eye movement data in 3D environments. With the introduction of affordable and non-intrusive eye-tracking solutions to the mass market, access to users' gaze is now increasingly possible. As a result, the adoption of eye-tracking in virtual environments using head-mounted displays is expected to increase since the trend is to incorporate gaze tracking as part of new technical solutions. The systematic literature review presented in this paper was conducted using the Scopus database (using the period 2017 to 17th of May 2022), which after analysis, resulted in the inclusion of 15 recent publications with relevance in eye-tracking visualization techniques for 3D virtual scenes. First, this paper briefly describes the foundations of eye-tracking and traditional 2D visualization techniques. As background, we also list earlier 3D eye-tracking visualization techniques identified in a previous review. Next, the systematic literature review presents the method used to acquire the included papers and a description of these in terms of eye-tracking technology, observed stimuli, application context, and type of 3D gaze visualization techniques. We then discuss the overall findings, including opportunities, challenges, trends, and present ideas for future directions. Overall the results show that eye-tracking in immersive virtual environments is on the rise and that more research and developments are needed to create novel and improved technical solutions for 3D gaze analysis.
|
|
| 35. |
|
|
| 36. |
- Sundstedt, Veronica, 1979-, et al.
(author)
-
HINTS : Human-Centered Intelligent Realities
- 2023
-
In: 35th Annual Workshop of the Swedish Artificial Intelligence Society SAIS 2023. - : Linköping University Electronic Press. - 9789180752749 ; , s. 9-17
-
Conference paper (peer-reviewed)abstract
- During the last decade, we have witnessed a rapiddevelopment of extended reality (XR) technologies such asaugmented reality (AR) and virtual reality (VR). Further, therehave been tremendous advancements in artificial intelligence(AI) and machine learning (ML). These two trends will havea significant impact on future digital societies. The vision ofan immersive, ubiquitous, and intelligent virtual space opensup new opportunities for creating an enhanced digital world inwhich the users are at the center of the development process,so-calledintelligent realities(IRs).The “Human-Centered Intelligent Realities” (HINTS) profileproject will develop concepts, principles, methods, algorithms,and tools for human-centered IRs, thus leading the wayfor future immersive, user-aware, and intelligent interactivedigital environments. The HINTS project is centered aroundan ecosystem combining XR and communication paradigms toform novel intelligent digital systems.HINTS will provide users with new ways to understand,collaborate with, and control digital systems. These novelways will be based on visual and data-driven platforms whichenable tangible, immersive cognitive interactions within realand virtual realities. Thus, exploiting digital systems in a moreefficient, effective, engaging, and resource-aware condition.Moreover, the systems will be equipped with cognitive featuresbased on AI and ML, which allow users to engage with digitalrealities and data in novel forms. This paper describes theHINTS profile project and its initial results. ©2023, Copyright held by the authors
|
|
| 37. |
- Zepernick, Hans-Juergen, et al.
(author)
-
On the Number of Participants Needed for Subjective Quality Assessment of 360° Videos
- 2019
-
In: 13th International Conference on Signal Processing and Communication Systems, ICSPCS 2019 - Proceedings. - : Institute of Electrical and Electronics Engineers Inc.. - 9781728121949
-
Conference paper (peer-reviewed)abstract
- Immersive multimedia applications such as 360° videos and virtual reality (VR) live broadcasting are expected to receive increased popularity in the consumer markets. These applications provide three-dimensional spatial information and require to develop the related advanced wired and wireless ecosystems ranging from head-mounted displays (HMDs) and processors to network connectivity. To develop immersive multimedia systems that provide acceptable user experiences, it is essential to conduct subjective experiments that support assessing subjective video quality as perceived by the users. In this paper, we focus on the question of how many participants are needed in subjective experiments for 360° videos such that a statistically meaningful subjective quality assessment is supported. For this purpose, a subjective experiment for 360° videos has been conducted using the modified absolute category rating with hidden reference (M-ACR-HR) method. A statistical analysis of the opinion scores given by the participants to the visual stimuli shown on an HMD is provided. In particular, mean opinion scores (MOS), differential MOS (DMOS), and the associated margin of error (MoE) and differential MoE are obtained. It is shown that 21 to 26 participants would be sufficient to drive the differential MoE of the DMOS below the given thresholds of ϵ =1% and ϵ=0.75%, respectively. © 2019 IEEE.
|
|
