Search: onr:"swepub:oai:DiVA.org:kth-335694" >
Multimodal data fus...
Multimodal data fusion framework enhanced robot-assisted minimally invasive surgery
-
- Qi, Wen (author)
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Italy
-
- Su, Hang (author)
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Italy
-
- Fan, Ke (author)
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Italy
-
show more...
-
- Chen, Ziyang (author)
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Italy
-
- Li, Jiehao (author)
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Italy
-
- Zhou, Xuanyi (author)
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Italy
-
- Hu, Yingbai (author)
- Department of Informatics, Technical University of Munich, Germany
-
- Zhang, Longbin (author)
- KTH,Farkostteknik och Solidmekanik
-
- Ferrigno, Giancarlo (author)
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Italy
-
- De Momi, Elena (author)
- Dipartimento di Elettronica, Informazione e Bioingegneria, Politecnico di Milano, Italy
-
show less...
-
(creator_code:org_t)
- 2021-01-18
- 2022
- English.
-
In: Transactions of the Institute of Measurement and Control. - : SAGE Publications. - 0142-3312 .- 1477-0369. ; 44:4, s. 735-743
- Related links:
-
https://urn.kb.se/re...
-
show more...
-
https://doi.org/10.1...
-
show less...
Abstract
Subject headings
Close
- The generous application of robot-assisted minimally invasive surgery (RAMIS) promotes human-machine interaction (HMI). Identifying various behaviors of doctors can enhance the RAMIS procedure for the redundant robot. It bridges intelligent robot control and activity recognition strategies in the operating room, including hand gestures and human activities. In this paper, to enhance identification in a dynamic situation, we propose a multimodal data fusion framework to provide multiple information for accuracy enhancement. Firstly, a multi-sensors based hardware structure is designed to capture varied data from various devices, including depth camera and smartphone. Furthermore, in different surgical tasks, the robot control mechanism can shift automatically. The experimental results evaluate the efficiency of developing the multimodal framework for RAMIS by comparing it with a single sensor system. Implementing the KUKA LWR4+ in a surgical robot environment indicates that the surgical robot systems can work with medical staff in the future.
Subject headings
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Robotteknik och automation (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Robotics (hsv//eng)
Keyword
- event-based control
- human activity recognition
- minimally invasive surgery
- Multimodal data fusion
- redundant manipulator
Publication and Content Type
- ref (subject category)
- art (subject category)
Find in a library
To the university's database
- By the author/editor
-
Qi, Wen
-
Su, Hang
-
Fan, Ke
-
Chen, Ziyang
-
Li, Jiehao
-
Zhou, Xuanyi
-
show more...
-
Hu, Yingbai
-
Zhang, Longbin
-
Ferrigno, Gianca ...
-
De Momi, Elena
-
show less...
- About the subject
-
- ENGINEERING AND TECHNOLOGY
-
ENGINEERING AND ...
-
and Electrical Engin ...
-
and Robotics
- Articles in the publication
-
Transactions of ...
- By the university
-
Royal Institute of Technology