1. |
- Ak, Abdullah Cihan, et al.
(author)
-
Learning Failure Prevention Skills for Safe Robot Manipulation
- 2023
-
In: IEEE Robotics and Automation Letters. - Piscataway, NJ : IEEE. - 2377-3766. ; 8:12, s. 7994-8001
-
Journal article (peer-reviewed)abstract
- Robots are more capable of achieving manipulation tasks for everyday activities than before. However, the safety of manipulation skills that robots employ is still an open problem. Considering all possible failures during skill learning increases the complexity of the process and restrains learning an optimal policy. Nonetheless, safety-focused modularity in the acquisition of skills has not been adequately addressed in previous works. For that purpose, we reformulate skills as base and failure prevention skills, where base skills aim at completing tasks and failure prevention skills aim at reducing the risk of failures to occur. Then, we propose a modular and hierarchical method for safe robot manipulation by augmenting base skills by learning failure prevention skills with reinforcement learning and forming a skill library to address different safety risks. Furthermore, a skill selection policy that considers estimated risks is used for the robot to select the best control policy for safe manipulation. Our experiments show that the proposed method achieves the given goal while ensuring safety by preventing failures. We also show that with the proposed method, skill learning is feasible and our safe manipulation tools can be transferred to the real environment © 2023 IEEE
|
|
2. |
- Inceoglu, Arda, et al.
(author)
-
FINO-Net : A Deep Multimodal Sensor Fusion Framework for Manipulation Failure Detection
- 2021
-
In: 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). - : IEEE. - 9781665417143 - 9781665417150 ; , s. 6841-6847
-
Conference paper (peer-reviewed)abstract
- We need robots more aware of the unintended outcomes of their actions for ensuring safety. This can be achieved by an onboard failure detection system to monitor and detect such cases. Onboard failure detection is challenging with a limited set of onboard sensor setup due to the limitations of sensing capabilities of each sensor. To alleviate these challenges, we propose FINO-Net, a novel multimodal sensor fusion based deep neural network to detect and identify manipulation failures. We also introduce FAILURE, a multimodal dataset, containing 229 real-world manipulation data recorded with a Baxter robot. Our network combines RGB, depth and audio readings to effectively detect failures. Results indicate that fusing RGB with depth and audio modalities significantly improves the performance. FINO-Net achieves %98.60 detection accuracy on our novel dataset. Code and data are publicly available at https://github.com/ardai/fino-net.
|
|