| 1. |
|
|
| 2. |
- Bhatt, Mehul, Professor, 1980-, et al.
(författare)
-
Artificial Intelligence for Predictive and Evidence Based Architecture Design
- 2016
-
Ingår i: Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence (AAAI-16). - : AAAI press. - 9781577357605 ; , s. 4349-4350
-
Konferensbidrag (refereegranskat)abstract
- The evidence-based analysis of people's navigation and wayfinding behaviour in large-scale built-up environments (e.g., hospitals, airports) encompasses the measurement and qualitative analysis of a range of aspects including people's visual perception in new and familiar surroundings, their decision-making procedures and intentions, the affordances of the environment itself, etc. In our research on large-scale evidence-based qualitative analysis of wayfinding behaviour, we construe visual perception and navigation in built-up environments as a dynamic narrative construction process of movement and exploration driven by situation-dependent goals, guided by visual aids such as signage and landmarks, and influenced by environmental (e.g., presence of other people, time of day, lighting) and personal (e.g., age, physical attributes) factors. We employ a range of sensors for measuring the embodied visuo-locomotive experience of building users: eye-tracking, egocentric gaze analysis, external camera based visual analysis to interpret fine-grained behaviour (e.g., stopping, looking around, interacting with other people), and also manual observations made by human experimenters. Observations are processed, analysed, and integrated in a holistic model of the visuo-locomotive narrative experience at the individual and group level. Our model also combines embodied visual perception analysis with analysis of the structure and layout of the environment (e.g., topology, routes, isovists) computed from available 3D models of the building. In this framework, abstract regions like the visibility space, regions of attention, eye movement clusters, are treated as first class visuo-spatial and iconic objects that can be used for interpreting the visual experience of subjects in a high-level qualitative manner. The final integrated analysis of the wayfinding experience is such that it can even be presented in a virtual reality environment thereby providing an immersive experience (e.g., using tools such as the Oculus Rift) of the qualitative analysis for single participants, as well as for a combined analysis of large group. This capability is especially important for experiments in post-occupancy analysis of building performance. Our construction of indoor wayfinding experience as a form of moving image analysis centralizes the role and influence of perceptual visuo-spatial characteristics and morphological features of the built environment into the discourse on wayfinding research. We will demonstrate the impact of this work with several case-studies, particularly focussing on a large-scale experiment conducted at the New Parkland Hospital in Dallas Texas, USA.
|
|
| 3. |
- Bhatt, Mehul, Professor, 1980-
(författare)
-
Cognitive media studies : Potentials for spatial cognition and AI research
- 2018
-
Ingår i: Cognitive Processing. - : Springer Berlin/Heidelberg. - 1612-4782 .- 1612-4790. ; 19:Suppl. 1, s. S6-S6
-
Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)abstract
- Cognitive media studies has developed as an area of research at the interface of disciplines as diverse as aesthetics, psychology, neuroscience, film theory, and cognitive science. In this context, the focus of this talk is on the foundational significance of artificial intelligence and visuo-spatial cognition and computation for the design of inte-grated analytical–empirical methods for the (multi-modal) analysis of human behaviour data vis-a-vis a range of digital visuo-auditory narrative media (e.g., narrative film). The presentation focusses on the methodological foundations and assistive technologies for systematic formalization and empirical analyses aimed at, for instance, the generation of evidence, establishing and characterizing correlates between principles for the synthesis of the moving image (e.g., from a cinematographic viewpoint), and its perceptual recipient effects and influence on observers.In the backdrop a range of completed and ongoing experiments, we emphasize the core results on the semantic interpretation of human behaviour vis-a-vis narrative film and its visuo-auditory reception. We demonstrate the manner in which AI-based models for machine coding of narrative, and relational inference and learning serves as basis to externalize explicit and inferred knowledge about embodied visuo-auditory reception, e.g., using modalities such as diagrammatic representations, natural language, complex (dynamic) data visualizations.Demonstration: The presentation will particularly showcase methods and tools developed to perform perceptual narrativisation or sensemaking with multi-modal, dynamic human-behaviour data (combining visuo-spatial imagery such as film/video, eye-tracking, head-tracking during a perception task) for a chosen set of experimental material based on existing films, as well as lab-developed experimental content.
|
|
| 4. |
- Bhatt, Mehul, Professor, 1980-, et al.
(författare)
-
Cognitive robotics
- 2016
-
Ingår i: Journal of experimental and theoretical artificial intelligence (Print). - : Taylor & Francis Group. - 0952-813X .- 1362-3079. ; 28:5, s. 779-780
-
Tidskriftsartikel (refereegranskat)
|
|
| 5. |
- Bhatt, Mehul, Professor, 1980-, et al.
(författare)
-
Declarative Spatial Reasoning for Intelligent Cinematography
- 2017
-
Ingår i: Workshop on Intelligent Cinematography and Editing, WICED 2017. - : Eurographics Association. - 9783038680314
-
Konferensbidrag (refereegranskat)abstract
- We present computational visuo-spatial representation and reasoning from the viewpoint of the research areas of artificial intelligence, spatial cognition and computation, and human-computer interaction. The particular focus is on demonstrating recent advances in the theory and practice of spatial reasoning, and its significance and potential as a foundational AI method for (intelligent) computational cinematography & editing systems.
|
|
| 6. |
- Bhatt, Mehul, Professor, 1980-, et al.
(författare)
-
Deep Semantics for Explainable Visuospatial Intelligence : Perspectives on Integrating Commonsense Spatial Abstractions and Low-Level Neural Features
- 2019
-
Ingår i: Proceedings of the 2019 International Workshop on Neural-Symbolic Learning and Reasoning.
-
Konferensbidrag (refereegranskat)abstract
- High-level semantic interpretation of (dynamic) visual imagery calls for general and systematic methods integrating techniques in knowledge representation and computer vision. Towards this, we position "deep semantics", denoting the existence of declarative models –e.g., pertaining "space and motion"– and corresponding formalisation and methods supporting (domain-independent) explainability capabilities such as semantic question-answering, relational (and relationally-driven) visuospatial learning, and (non-monotonic) visuospatial abduction. Rooted in recent work, we summarise and report the status quo on deep visuospatial semantics —and our approach to neurosymbolic integration and explainable visuo-spatial computing in that context— with developed methods and tools in diverse settings such as behavioural research in psychology, art & social sciences, and autonomous driving.
|
|
| 7. |
- Bhatt, Mehul, Professor, 1980-
(författare)
-
Embodied architecture design : On people-centered design of visuo-locomotive cognitive experiences
- 2018
-
Ingår i: Cognitive Processing. - : Springer Berlin/Heidelberg. - 1612-4782 .- 1612-4790. ; 19:Suppl. 1, s. S5-S5
-
Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)abstract
- This presentation focusses on the analysis and design of human-centered, embodied, cognitive user experiences from the perspectives of spatial cognition and computation, artificial intelligence, and human-computer interaction research. Focusing on large-scale built up spaces (in particular hospitals), this presentation will particularly address:‘how can human-centered cognitive modalities of visuo-locomotive perception constitute the foundational building blocks of design education, discourse, systems, and the professional practice of spatial design for architecture’.The presentation will emphasizeevidence-based multimodality studies from the viewpoints of visuo-locomotive (i.e., pertaining to vision, movement, and wayfinding) cognitive experiences. Modalities being investigated include: (1) visual attention (by eye-tracking), gesture, language, facial expressions; (2) human expert guided event segmentation (e.g., coming from behavioral or environmental psychologists, designers, annotators); (3) deep analysis based on dialogic components, think-aloud protocols. We demonstrate (1–3) in the context of a large-scale study conducted at the Old and New Parkland Hospitals in Dallas, Texas.This research (and symposium) calls for a tightly integrated approach combining analytical methods (rooted in AI and computational cognition) and empirical methods (rooted in psychology and perception studies) for developing human-centered architectural design technologies, and technology-mediated (architectural) design synthesis.
|
|
| 8. |
- Bhatt, Mehul, Professor, 1980-, et al.
(författare)
-
Embodied visuo-locomotive experience analysis : immersive reality based summarisation of experiments in environment-behaviour studies
- 2016
-
Ingår i: Proceedings of the ACM Symposium on Applied Perception (SAP 2016). - USA : ACM Digital Library. - 9781450343831 ; , s. 133-133
-
Konferensbidrag (refereegranskat)abstract
- Evidence-based design (EBD) for architecture involves the study of post-occupancy behaviour of building users with the aim to provide an empirical basis for improving building performance [Hamilton and Watkins 2009]. Within EBD, the high-level, qualitative analysis of the embodied visuo-locomotive experience of representative groups of building users (e.g., children, senior citizens, individuals facing physical challenges) constitutes a foundational approach for understanding the impact of architectural design decisions, and functional building performance from the viewpoint of areas such as environmental psychology, wayfinding research, human visual perception studies, spatial cognition, and the built environment [Bhatt and Schultz 2016].
|
|
| 9. |
- Bhatt, Mehul, Professor, 1980-
(författare)
-
Minds. Movement. Moving image
- 2018
-
Ingår i: Cognitive Processing. - : Springer Berlin/Heidelberg. - 1612-4782 .- 1612-4790. ; 19:Suppl. 1, s. S5-S5
-
Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)abstract
- This symposium—conducted in two parts—explores the confluence of empirically-based qualitative research in the cognitive and psychological sciences (focusing on visual and spatial cognition) with computationally-driven analytical methods (rooted in artificial intelligence) in the service of communications, media, design, and human behavioural studies. With a focus on architecture and visuo-auditory media design, the twin-symposia will demonstrate recent results and explore the synergy of research methods for the study of human behaviour in the chosen (design) contexts of socio-cultural, and socio-technological significance.The symposium brings together experts and addresses methodsand perspectives from:• Visuo-Spatial Cognition and Computation• Artificial Intelligence, Cognitive Systems• Multimodality and Interaction• Cognitive Science and Psychology• Neuroscience• Design Cognition and Computation• Communications and Media Studies• Architecture, Built Environment• Design Studies (focus on architecture and visuo-auditory media)• Evidence Based DesignThe symposium particularly emphasises the role of multimodality and mediated interaction for the analysis and design of human-centered, embodied, cognitive user experiences in everyday life and work. Here, the focus is on multimodality studies aimed at the semantic interpretation of human behaviour, and the empirically-driven synthesis of embodied interactive experiences in real world settings. In focus are narrative media design, architecture and built environment design, product design, cognitive media studies (film, animation, VR, sound and music design), and user interaction studies. In these contexts, the symposium emphasizes evidence-based multimodality studies from the viewpoints of visual (e.g.,attention and recipient effects), visuo-locomotive (e.g. , movement, wayfinding), and visuo-auditory (e.g., narrative media) cognitive experiences. Modalities being investigated include, but are not limited to:• visual attention (by eye-tracking), gesture, speech, language, facial expressions, tactile interactions, olfaction, biosignals;• human expert guided event segmentation (e.g. coming from behavioral or environmental psychologists, designers, annotators,crowd-sensing)• deep analysis based on dialogic components, think-aloud protocolsThe scientific agenda of the twin-symposia also emphasizes the multi-modality of the embodied visuo-spatial thinking involved in ‘‘problem-solving’’ for the design of objects, artefacts, and inter-active people-experiences emanating there from. Universality andinclusion in ‘‘design thinking’’ are of overarching focus in all design contexts relevant to the symposium; here, the implications of mul-timodality studies for inclusive design, e.g.,creation of presentations of the same content in different modalities, are also of interest. The symposium provides a platform to discuss the development of next-generation embodied interaction design systems, practices, and (human-centered) assistive frameworks and technologies encompassing the multi-faceted nature of embodied design conception and synthesis. Individual contributions/talks within the two symposia address the themes under consideration from formal, computational, cognitive, design, engineering, empirical, and philosophical perspectives.
|
|
| 10. |
- Bhatt, Mehul, Professor, 1980-, et al.
(författare)
-
Multimodality in Embodied Experience Design : Workshop at INTERACT 2017, Mumbai, INDIA
- 2017
-
Ingår i: Human-Computer Interaction – INTERACT 2017, Part IV. - Cham : Springer. ; , s. 533-534
-
Konferensbidrag (refereegranskat)abstract
- The workshop on Multimodality in Embodied Experience Design addresses the role of multimodality and mediated interaction for the analysis and design of human-centred, embodied, cognitive user experiences. Research topics being addressed encompass formal, computational, cognitive, design, engineering, empirical, and philosophical perspectives at the interface of artificial intelligence, cognitive science, and interaction design.
|
|
