Task-level decision-making for dynamic and stochastic human-robot collaboration based on dual agents deep reinforcement learning

• Human-robot collaboration as a multidisciplinary research topic is still pursuing the robots’ enhanced intelligence to be more human-compatible and fit the dynamic and stochastic characteristics of human. However, the uncertainties brought by the human partner challenge the task-planning and decision-making of the robot. When aiming at industrial tasks like collaborative assembly, dynamics on temporal dimension and stochasticities on the order of procedures need to be further considered. In this work, we bring a new perspective and solution based on reinforcement learning, where the problem is regarded as training an agent towards tasks in dynamic and stochastic environments. Concretely, an adapted training approach based on the deep Q learning method is proposed. This method regards both the robot and the human as the agents in the interactive training environment for deep reinforcement learning. With the consideration of task-level industrial human-robot collaboration, the training logic and the agent-environment interaction have been proposed. For the human-robot collaborative assembly tasks in the case study, it is illustrated that our method could drive the robot represented by one agent to collaborate with the human partner even the human performs randomly on the task procedures.

Ämnesord

TEKNIK OCH TEKNOLOGIER  -- Elektroteknik och elektronik -- Robotteknik och automation (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Electrical Engineering, Electronic Engineering, Information Engineering -- Robotics (hsv//eng)

Nyckelord

Decision-making

Deep reinforcement learning

Dynamic and stochastic tasks

Human-robot collaboration

Decision making

Deep learning

Educational robots

Industrial robots

Learning systems

Reinforcement learning

Robot programming

Stochastic systems

Collaborative assembly

Interactive training

Multi-disciplinary research

Q-learning method

Stochastic characteristic

Stochastic environment

Temporal dimensions

Social robots

Publikations- och innehållstyp

ref (ämneskategori)

art (ämneskategori)