| 1. |
- Backman, Anders, et al.
(author)
-
easyADL – Wearable Support System for Independent Life despite Dementia
- 2006
-
In: ACM CHI 2006 Workshop onDesigning Technology for People with Cognitive Impairments.
-
Conference paper (peer-reviewed)abstract
- This position paper outlines the easyADL project, a two-year project investigating the possibility of using wearable technology to assist people suffering the dementia disease in performing Activities of Daily Living (ADL). An introduction to the egocentric interaction modeling framework is provided and the virtual reality based development methodology is discusssed.
|
|
| 2. |
- Baskar, Jayalakshmi, et al.
(author)
-
Personalisation and user models for support in daily living
- 2012
-
In: The 27th annual workshop of the Swedish Artificial Intelligence Society (SAIS), 14–15 May 2012. ; , s. 7-16
-
Conference paper (peer-reviewed)abstract
- In recent years, the interest in developing personalised applications for home environment has grown since it has a wide reach in helping people in their daily activities. However, for our purposes the concept activities of daily living also need to include work and leisure activities not necessarily performed in home environments. In this article, we describe an ongoing effort to develop a generic framework for assessing ability and tailoring of support applications in the health domain. We also give an overview of the approaches that have been adopted for personalisation and user modelling to various application areas. Suggestions of future development are provided.
|
|
| 3. |
- Lindgren, Helena, et al.
(author)
-
Agent-supported assessment for adaptive and personalized ambient assisted living
- 2011
-
In: Trends in practical applications of agents and multiagent systems. - Berlin/Heidelberg : Springer Berlin/Heidelberg. - 9783642199301 ; , s. 25-32
-
Conference paper (peer-reviewed)abstract
- Existing approaches to ambient assisted living (AAL) often fail to consider a human agent's needs from a holistic perspective. In particular the regular assessment of their changing abilities, skills and limitations are often treated as a separate matter in healthcare, thereby affecting the possibilities to provide support tailored to their current condition. Therefore, the objective of this work is to integrate assessment done by the healthcare professional into the framework of AAL. We propose a framework based on a model for activity-centered modeling of knowledge and interaction tailored to users (ACKTUS) and an egocentric interaction model. We exemplify the interaction between system modules as agent dialogues in assessment and adaptation for supporting an older adult in a home environment.
|
|
| 4. |
- Nieves, Juan Carlos, 1976-, et al.
(author)
-
Modeling Actions Based on a Situative Space Model for Recognizing Human Activities
- 2012
-
In: Artificial Intelligence. - : Springer. ; , s. 266-275
-
Conference paper (peer-reviewed)abstract
- Human activities usually have a motive and are driven bygoal directed sequence of actions. Recognizing and supporting humanactivities is an important challenge for ambient assisted living of elderlyin their home environment. By understanding an activity as a sequence ofactions, we explore action specification languages for recognizing humanactivities. In this setting, we analyze the role of the situative space modelfor modeling indoor human activities in terms of an action specificationlanguage.
|
|
| 5. |
- Pederson, Thomas, et al.
(author)
-
A situative space model for distributed multimodal interaction
- 2008
-
Conference paper (peer-reviewed)abstract
- This workshop paper presents a body-centered model of human-environment interaction based on proximal and perceptional relationships between the human actor and objects of interest (physical objects, virtual objects, and mediators). The model is applied to a real world scenario and also discussed as a tool for designing a distributed multimodal interaction infrastructure.
|
|
| 6. |
- Pederson, Thomas, et al.
(author)
-
A situative space model for mobile mixed-reality computing
- 2011
-
In: IEEE pervasive computing. - New York, NY : IEEE Computer Society. - 1536-1268 .- 1558-2590. ; 10:4, s. 73-83
-
Journal article (peer-reviewed)abstract
- This article proposes a situative space model that links the physical and virtual realms and sets the stage for complex human-computer interaction defined by what a human agent can see, hear, and touch, at any given point in time.
|
|
| 7. |
- Pederson, Thomas, et al.
(author)
-
Framing the Next-Generation ‘Desktop’ using Proximity and Human Perception
- 2008
-
In: ACM CHI 2008 Conference Workshop on User Interface Description Languages for Next-Generation User Interfaces.
-
Conference paper (peer-reviewed)abstract
- Personal computing, and therefore Human-Computer Interaction (HCI), is becoming a seamlessly integrated part of everyday activity down to the point where "computing" is inseparable from "activity". A modelling problem occurs in these emerging mobile and ubiquitous computing situations because it is hard to determine the spatial and operational limits of an ongoing activity, for the human performing the activity, for the computer system monitoring and/or supporting it, as well as for the modeller observing it. Also, it is an open issue how to model the causal relations between physical (real world) and virtual (digital world) phenomena that these "intelligent environments" can be programmed to maintain, whether defined by software engineers or the end-users themselves. We propose a modeling framework that addresses the above mentioned issues and present our initial attempts to create a User Interface Description Language (UIDL) based on the framework.
|
|
| 8. |
- Pederson, Thomas, et al.
(author)
-
Towards a model for egocentric interaction with physical and virtual objects
- 2010
-
In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction. - New York, USA : ACM Press. - 9781605589343 ; , s. 755-758
-
Conference paper (peer-reviewed)abstract
- Designers of mobile context-aware systems are struggling with the problem of conceptually incorporating the real world into the system design. We present a body-centric modeling framework (as opposed to device-centric) that incorporates physical and virtual objects of interest on the basis of proximity and human perception, framed in the context of an emerging "egocentric" interaction paradigm.
|
|
| 9. |
- Pederson, Thomas, et al.
(author)
-
Towards an activity-aware wearable computing platform based on an egocentric interaction model
- 2007
-
In: Proceedings of the 4th International Symposium on Ubiquitous Computing Systems. - Berlin/Heidelberg : Springer Berlin/Heidelberg. - 9783540767718 ; , s. 211-227
-
Conference paper (peer-reviewed)abstract
- In this paper, we present our egocentric interaction model for recognizing and supporting everyday human activities. We explain how it allows designers of ubiquitous computing systems to view physical (real) and virtual (digital) objects as residing in one single space and how sets of objects in the vicinity of a specific human actor can be classified based on human perceptual characteristics such as what can be observed and what can be manipulated. We also propose a wearable computer architecture that is based on the egocentric interaction model which potentially could facilitate the development of Ubiquitous Computing applications by letting an operating system take care of maintaining communication with worn and instrumented sensors as well as computing devices. Finally, we present our first steps in implementing an activity-aware wearable support system for people suffering mild dementia based on the proposed model and architecture.
|
|
| 10. |
- Surie, Dipak, et al.
(author)
-
A Smart Home Experience using Egocentric Interaction Design Principles
- 2012
-
In: 15TH IEEE International Conference On Computational Science And Engineering (CSE 2012) / 10TH IEEE/IFIP International Conference On Embedded And Ubiquitous Computing (EUC 2012). - 9781467351652 ; , s. 656-665
-
Conference paper (peer-reviewed)abstract
- The landscape of ubiquitous computing comprising of numerous interconnected computing devices seamlessly integrated within everyday environments introduces a need to do research beyond human-computer interaction: in particular incorporate human-environment interaction. While the technological advancements have driven the field of ubiquitous computing, the ultimate focus should center on human agents and their experience in interacting with ubiquitous computing systems offering smart services. This paper describes egocentric interaction as a human body-centered interaction paradigm for framing human-environment interaction using proximity and human perception. A smart home environment capable of supporting physical-virtual activities and designed according to egocentric interaction principles is used for exploring the human experience it offers, yielding positive results as a proof of concept.
|
|
| 11. |
- Surie, Dipak, 1981-, et al.
(author)
-
Activity recognition based on intra and extra manipulation of everyday objects
- 2007
-
In: Proceedings of the 4th International Symposium on Ubiquitous Computing Systems. - Berlin/Heidelberg : Springer Berlin/Heidelberg. - 3540767711 - 9783540767718 ; , s. 196-210
-
Conference paper (peer-reviewed)abstract
- Recognizing activities based on an actor's interaction with everyday objects is an important research approach within ubiquitous computing. We present a recognition approach which complement objects grabbed or released information with the object's internal state changes (as an effect of intra manipulation) and the object's external state changes with reference to other objects (as an effect of extra manipulation). The concept of Intra manipulation is inspired by the fact that many everyday objects change their internal state when manipulated by the human actor, while extra manipulation is motivated by the fact that humans commonly rearrange the spatial relations between everyday objects as part of their activities. A detailed evaluation of our prototype activity recognition system in virtual reality (VR) environment is presented as a "proof of concept". We have obtained a recognition precision of 92% on the activity-level and 81% on the action-level among 15 everyday home activities. Virtual reality was used as a test-bed in order to speed up the design process of our activity recognition system, allowing us to compensate for the limitations with currently available sensing technologies and to compare the contributions of intra manipulation and extra manipulation for activity recognition.
|
|
| 12. |
- Surie, Dipak, 1981-, et al.
(author)
-
Activity recognition using an egocentric perspective of everyday objects
- 2007
-
In: Proceedings of the 4th International Conference on Ubiquitous Intelligence and Computing. - : Springer Berlin/Heidelberg. ; , s. 246-257
-
Conference paper (peer-reviewed)abstract
- This paper presents an activity recognition approach based on the tracking of a specific human actor’s current object manipulation actions, complemented by two kinds of situational information: 1) the set of objects that are visually observable (inside the “observable space”) and 2) technically graspable (inside the “manipulable space”). This “egocentric” model is inspired by situated action theory and offers the advantage of not depending on technology for absolute positioning of neither the human nor the objects. Applied in an immersive Virtual Reality environment, the proposed activity recognition approach shows a recognition precision of 89% on the activity-level and 76% on the action-level among 10 everyday home activities.
|
|
| 13. |
- Surie, Dipak, 1981-, et al.
(author)
-
An activity-centered wearable computing infrastructure for intelligent environment applications
- 2007
-
In: Proceedings of the International Conference on Embedded and Ubiquitous Computing. - Berlin/Heidelberg : Springer Berlin/Heidelberg. - 9783540770916 ; , s. 456-465
-
Conference paper (peer-reviewed)abstract
- There are many research efforts that focus on converting everyday environments into intelligent and computationally active environments that support and enhance the abilities of its occupants in executing their activities. Such environments must have the ability to recognize the activities performed by its occupant, maintain a real-time model of the environment, address the occupant's privacy and personalization issues, and provide interaction capabilities in a way the occupant would with other people. In this paper we present an activity-centered wearable computing infrastructure for designing intelligent environment applications based on the occupant's usage and storage of everyday objects in that environment. Four components namely object manager, situative space monitor, activity recognizer and egocentric interaction manager are introduced and described in detail. A prototypical intelligent home environment capable of supporting 15 Activities of Daily Living with an activity recognition precision of 92% is presented as a "proof of concept" in a virtual reality (VR) simulated home environment.
|
|
| 14. |
- Surie, Dipak, et al.
(author)
-
Egocentric interaction as a tool for designing ambient ecologies : the case of the easy ADL ecology
- 2012
-
In: Pervasive and Mobile Computing. - : Elsevier. - 1574-1192 .- 1873-1589. ; 8:4, s. 597-613
-
Journal article (peer-reviewed)abstract
- The visions of ambient intelligence demand novel interaction paradigms that enable designers and system developers to frame and manage the dynamic and complex interaction between humans and environments populated with physical (real) and virtual (digital) objects of interest. So far, many proposed approaches have adhered to a device-centric stance when including virtual objects into the ambient ecology; a stance inherited from existing interaction paradigms for mobile and stationary interactive devices. In this article, we introduce egocentric interaction as an alternative approach, taking the human agent's body and mind as the center of reference. We show how this interaction paradigm has influenced both the conception and implementation of the easy ADL ecology, comprising of smart objects, a personal activity-centric middleware attempting to simplify interaction given available resources, ambient intelligence applications aimed at everyday activity support, and a human agent literally in the middle of it all.
|
|
| 15. |
- Surie, Dipak, 1981-
(author)
-
Egocentric interaction for ambient intelligence
- 2012
-
Doctoral thesis (other academic/artistic)abstract
- Ambient intelligence refers to the vision of computationally augmented everyday environments that are sensitive, adaptive and responsive to humans and intelligently support their daily lives. Ambient ecologies are the infrastructures of ambient intelligence. To enable system developers to frame and manage the dynamic and complex interaction of humans with ambient ecologies consisting of a mixture of physical (real) and virtual (digital) objects, novel interaction paradigms are needed. Traditional interaction paradigms like the WIMP (windows, icon, menus, and pointing devices) paradigm for desktop computing operate in a closed world, unaware of the physical, social and cultural context. They restrict human perception and action to screen, mouse and keyboard with the assumption that human attention will be fully devoted to interaction with the computer. Emerging interaction paradigms for ambient intelligence are typically centered on specific devices, specific computing environments or specific human capabilities. Also, many of them are driven by technological advancements rather than viewing the human agent as their starting point. A principled, theoretical approach centered in the individual human agent, their situation and activities that are comprehensive and integrated while at the same time instrumental in the design of ambient ecologies has been lacking. This thesis introduces egocentric interaction as an approach towards the modeling of ambient ecologies with the distinguishing feature of taking the human agent’s body, situation and activities as center of reference, as opposed to the more common device-centric approaches in facilitating human-environment interaction. Egocentric interaction is encapsulated in a number of assumptions and principles such as situatedness, the proximity principle, the physical-virtual equity principle, perception and action instead of “input” and “output,” and activity-centeredness. A situative space model is proposed based on some of these principles. It is intended to capture what a specific human agent can perceive and not perceive, reach and not reach at any given moment in time. The situative space model is for the egocentric interaction paradigm what the virtual desktop is for the WIMP interaction paradigm: more or less everything of interest to a specific human agent is assumed and supposed to happen here. In addition, the conception and implementation of the easy ADL ecology based on egocentric interaction, comprising of smart objects, a personal activity-centric middleware, ambient intelligence applications aimed at everyday activity support, and a human agent literally in the middle of it all is described. The middleware was developed to address important challenges in ambient intelligence: (1) tracking and managing smart objects; (2) tracking a human agent’s situative spaces; (3) recognizing human activities and actions; (4) managing and facilitating human-environment interaction; and (5) to ease up the development of ambient intelligence applications. The easy ADL ecology was first simulated in immersive virtual reality, and then set up physically as a living laboratory to evaluate: (1) the technological and technical performance of individual middleware components, (2) to perform a user experience evaluation assessing various aspects of user satisfaction in relation to the support offered by the easy ADL ecology, and (3) to use it as a research test bed for addressing challenges in ambient intelligence. While it is problematic to directly compare the “proof-of-concept” easy ADL ecology with related research efforts, it is clear from the user experience evaluation that the subjects were positive with the services it offered.
|
|
| 16. |
- Surie, Dipak
(author)
-
Evaluation and Integration of Risk Management in CMMI and ISO/IEC 15504
- 2004
-
Conference paper (peer-reviewed)abstract
- During software development, software companies are exposed to risks (unwanted events) which lead to economic and competitive loss. Risk management technique can be used to minimise the loss in software projects. Some software process improvement models include risk management among their guidelines. The goal of this paper is to evaluate and analyse how risk management is handled by Capability Maturity Model Integration (CMMI) and International Organization for Standardization/International Electrotechnical Commision (ISO/IEC) 15504. A risk management framework is used in this evaluation study. The results of this study show that risk management in CMMI is more comprehensive than ISO/IEC 15504, but both models handle risk factors to appreciable extent.
|
|
| 17. |
- Surie, Dipak, et al.
(author)
-
Human cognition as a foundation for the emerging egocentric interaction paradigm
- 2012
-
In: Human-Computer Interaction: The Agency Perspective. - Berlin/Heidelberg : Springer Berlin/Heidelberg. - 9783642256905 ; , s. 349-374
-
Book chapter (peer-reviewed)abstract
- This chapter presents an “egocentric interaction paradigm” (EIP) centered on human agents rather than on the notion of user. More specifically, this paradigm is based on perception, action, intention and attention capabilities and limitations of human agents. Traditional and emerging interaction paradigms are typically related to a specific computing environment, devices or human capabilities. The novelty of the proposed approach stems from aiming at developing a comprehensive and integrated theoretical approach, centered on individual human agent. Development in Human-Computer Interaction (HCI) has been closely related to the understanding and utilization of natural human skills and abilities. This work attempts to understand and model a human agent, and in particular their cognitive capabilities in facilitating HCI. The EIP is based on principles like situatedness and embodiment, the physical-virtual equity principle, and the proximity principle. A situative space model built upon our understanding of human cognition is described in detail, followed by our experience in exploring the egocentric interaction paradigm in the easy ADL home.
|
|
| 18. |
- Surie, Dipak, 1981-, et al.
(author)
-
Human Sensing using Computer Vision for Personalized Smart Spaces
- 2013
-
In: 2013 IEEE 10th International Conference on and 10th International Conference on Autonomic and Trusted Computing (UIC/ATC) Ubiquitous Intelligence and Computing. ; , s. 487-494
-
Conference paper (peer-reviewed)abstract
- Smart spaces are everyday environments augmented with computing technologies that enhance human experience and activity performance. Continuous recognition of the presence of people, their identity, location, movement and activity patterns in real-time is a key challenge to address if smart spaces are to be envisioned as personalized and adaptive spaces. This paper introduces the multiple technologies available for human sensing and identification, discussing their advantages and disadvantages. In particular, Kitchen As-A-Pal is described as a smart space with real-time human sensing capabilities using computer vision by fusing fisher face recognition and skeletal tracking approaches. A wall-mounted Kinect is used for both single occupant and multi-occupant settings in kitchen As-A-Pal. The fused approach gives human identity recognition accuracy of 91.75% precision and 66% recall values for single occupant setting with good smart space coverage. Challenges do exist for human identity recognition in multi-occupant settings.
|
|
| 19. |
- Surie, Dipak, 1981-, et al.
(author)
-
Kitchen AS-A-PAL : Exploring Smart Objects as Containers, Surfaces and Actuators
- 2013
-
In: Ambient Intelligence - Software and Applications. - Heidelberg : Springer Publishing Company. - 9783319005652 - 9783319005669 ; , s. 171-178
-
Conference paper (peer-reviewed)abstract
- Technological advancements have taken us closer to the "kitchen of the future" where everyday kitchen activities are seamlessly integrated with smart computing services. While there exist smart kitchen approaches, the explorative nature of the field encourages novel designs. This paper follows the trend by describing the design and development of the Kitchen AS-A-PAL, an infrastructure for facilitating smart kitchen services. Smart objects are the building blocks of Kitchen AS-A-PAL where three types of smart objects namely Containers, Surfaces and Actuators are explored through smart kitchen applications including interactive cookbook, health'n shopping and kaffe, god morgon.
|
|
| 20. |
- Surie, Dipak, 1981-, et al.
(author)
-
Proxemics Awareness in Kitchen AS-A-PAL : Tracking Objects and Human in Perspective
- 2013
-
In: Intelligent Environments (IE), 2013 9th International Conference on. - 9780769550381 ; , s. 157-164
-
Conference paper (peer-reviewed)abstract
- Spatial relationships or proxemics play an important role in how humans interact with other people and objects in an environment, yet spatial relationships are not thoroughly exploited within smart environments. Objects designed to be aware of its proxemics facilitate implicit and explicit interaction with humans. Kitchen As-A-Pal is an interactive smart kitchen that provides an infrastructure for sensing and modeling proxemics among objects and human using a sonar network and RFID technology. Position, movement, identity and location are the proxemics dimensions explored in kitchen As-A-Pal. A pilot study of a breakfast scenario comprising of 9 everyday activities in Kitchen As-A-Pal using 2 subjects yielded promising proximity tracking results with a precision of 100% and a recall of 68.3% for spatial zones with high and medium average time percentages (ATP). Also, 53.21% ATP has more than 95% recall values.
|
|
| 21. |
- Surie, Dipak, et al.
(author)
-
Situative space tracking within smart environments
- 2010
-
In: Proceedings of the 6th International Conference on Intelligent Environments, IE 2010. - Washington, DC, USA : IEEE Computer Society. - 9780769541495 ; , s. 152-157
-
Conference paper (peer-reviewed)abstract
- This paper describes our efforts in modeling and tracking a human agent’s situation based on their possibilities to perceive and act upon objects (both physical and virtual) within smart environments. A Situative Space Model is proposed. WLAN signal-strength-based situative space tracking system that positions objects within individual situative spaces (without tracking their absolute positions) distributed across multiple modalities like vision, audio, and touch is presented. As a proof-of-concept, a preliminary evaluation of the tracking system was performed by two subjects within a living-laboratory smart home environment where a global tracking precision of 83.4% and a recall of 88.6% were obtained.
|
|
| 22. |
- Surie, Dipak, et al.
(author)
-
The Design of Personalised, Experiential Learning Infrastructure Centred On Human Cognition and Emerging Pedagogical Trends
- 2023
-
In: Proceedings of The 6th World Conference on Future of Education. - Milan, Italy. - 9786094853944
-
Conference paper (other academic/artistic)abstract
- Advancements in digital technologies such as artificial intelligence (AI) and virtual reality (VR) together with an improved understanding of human cognition call for a re-thinking of the approach to education. There is potential for better use of human resources, and opportunities for pedagogical improvements. AI can personalize and optimize learning environments, help students become more creative and enthusiastic through gamification, and help them gravitate towards suitable professional roles. Knowledge about human nature, cognition, learning and universal design principles make it possible to create a flexible and adaptable e-learning infrastructure personalisable to the learner’s needs through human-centred AI. This paper presents an e-learning infrastructure (GamiLearn.AI) powered by the latest developments in AI, VR, cognitive science and emerging pedagogy trends to help job seeking students gain experiential learning through industry projects, internships, and active engagement with organizations, while smoothly gravitating towards a suitable professional position and a better self-understanding. In an attempt to cope with the dynamic market conditions, and the influence of digitalisation organizations are in constant search for suitable employees who would fit their organization, the ongoing projects and the specialized roles expected of them with minimal training and skill development. The proposed self-paced and self-curated e-learning infrastructure creates win-win situations for all involved stakeholders through personalisation, gamification and experiential learning. This research is grounded in design thinking and user research. The results from a focus group discussion, three interviews with IT organizations and two workshops with students has driven the design of the proposed Gamilearn.AI e-learning infrastructure.
|
|
| 23. |
- Surie, Dipak, 1981-, et al.
(author)
-
The easy ADL home: A physical-virtual approach to domestic living
- 2010
-
In: Journal of Ambient Intelligence and Smart Environments. - Amsterdam, The Netherlands : IOS Press. - 1876-1364 .- 1876-1372. ; 2:3, s. 287-310
-
Journal article (peer-reviewed)abstract
- Smart environments worthy of the name need to capture, interpret, and support human activities that take place within their realms. Most existing efforts tend to focus on either real world activities or activities taking place in the virtual world accessed through digital devices. However, as digital computation continues to permeate our everyday real world environments, and as the border between physical and digital continues to blur for the human agents acting in these environments, we need system design approaches that can cope with human activities that span the physical-virtual gap. In this paper, we present such an approach and use it for designing a smart home intended to support Activities of Daily Living (ADL). The easy ADL home is designed based on a wearable personal server that runs a personal ADL support middleware and a set of computationally augmented everyday objects within the easy ADL home. An initial qualitative study of the system involving 20 subjects revealed a highly positive attitude (score 4.37 out of 5) towards the system's capability of co-locating and synchronizing physical and virtual events throughout the everyday activity scenarios, while classical usability aspects in particular related to the gesture-based input (score 2.89 out of 5) leaves room for improvement.
|
|
| 24. |
- Surie, Dipak, et al.
(author)
-
Wireless sensor networking of everyday objects in a smart home environment
- 2008
-
In: Proceedings of the International Conference on Intelligent Sensors, Sensor Networks and Information Processing, 2008. - : IEEE Computer Society. - 9781424429578 ; , s. 189-194
-
Conference paper (peer-reviewed)abstract
- Within a smart home environment the information processing is supposed to be thoroughly integrated into everyday objects. This introduces the need to keep track of the everyday objects and their state changes produced based on the userpsilas interaction with them. Such information is useful in recognizing the userpsilas activities, situations, etc. In this paper we present a ZigBee communication protocol based wireless sensor networking of 42 everyday objects (embedded with 81 simple state change sensors of 8 sensor types) in a living laboratory smart home environment. The system was evaluated in a realistic setup with background noise. The sensing module has shown promising results with an overall system precision of 91.2% and a recall of 98.8% in keeping track of the state changes to everyday objects. The signal strength measure above the acceptable limit of >10 dB to obtain reliable data communication was found to be 97.5% checked at 8 different locations in a home environment. Finally the transmission-reception range was evaluated to be 33 m with a single wall obstruction and 19 m with multiple wall obstruction in an indoor environment.
|
|
