| 1. |
- Billing, Erik, 1981-, et al.
(författare)
-
Finding Your Way from the Bed to the Kitchen: Reenacting and Recombining Sensorimotor Episodes Learned from Human Demonstration
- 2016
-
Ingår i: Frontiers in Robotics and Ai. - Lausanne, Switzerland : Frontiers Media SA. - 2296-9144. ; 3
-
Tidskriftsartikel (refereegranskat)abstract
- Several simulation theories have been proposed as an explanation for how humans and other agents internalize an "inner world" that allows them to simulate interactions with the external real world - prospectively and retrospectively. Such internal simulation of interaction with the environment has been argued to be a key mechanism behind mentalizing and planning. In the present work, we study internal simulations in a robot acting in a simulated human environment. A model of sensory-motor interactions with the environment is generated from human demonstrations and tested on a Robosoft Kompai robot. The model is used as a controller for the robot, reproducing the demonstrated behavior. Information from several different demonstrations is mixed, allowing the robot to produce novel paths through the environment, toward a goal specified by top-down contextual information. The robot model is also used in a covert mode, where the execution of actions is inhibited and perceptions are generated by a forward model. As a result, the robot generates an internal simulation of the sensory-motor interactions with the environment. Similar to the overt mode, the model is able to reproduce the demonstrated behavior as internal simulations. When experiences from several demonstrations are combined with a top-down goal signal, the system produces internal simulations of novel paths through the environment. These results can be understood as the robot imagining an "inner world" generated from previous experience, allowing it to try out different possible futures without executing actions overtly. We found that the success rate in terms of reaching the specified goal was higher during internal simulation, compared to overt action. These results are linked to a reduction in prediction errors generated during covert action. Despite the fact that the model is quite successful in terms of generating covert behavior toward specified goals, internal simulations display different temporal distributions compared to their overt counterparts. Links to human cognition and specifically mental imagery are discussed.
|
|
| 2. |
|
|
| 3. |
- Kiryazov, Kiril, et al.
(författare)
-
From the virtual to the robotic : Bringing emoting and appraising agents into reality
- 2011
-
Ingår i: Proceedings of the 2nd European Future Technologies Conference and Exhibition 2011 (FET 11). - : Elsevier. ; , s. 241-243
-
Konferensbidrag (refereegranskat)abstract
- - A classical appraisal model of emotions extended with artificial metabolic mechanisms is presented. The new architecture is based on two existing models: WASABI and a model of Microbial Fuel Cell technology. WASABI is a top-down cognitive model which is implemented in several virtual world applications such as a museum guide. Microbial fuel cells provide energy for the robot through digesting food. The presented work is a first step towards imbuing a physical robot with emotions of human-like complexity. Classically, such integration has only been attempted in the virtual domain. The research aim is to study the embodied appraisal theory and to show the role of the body in the emotion mechanisms. Some initial tests of the architecture with humanoid NAO robot in a minimalistic scenario are presented. © Selection and peer-review under responsibility of FET11 conference organizers and published by Elsevier B.V.
|
|
| 4. |
- Kiryazov, Kiril, et al.
(författare)
-
Modelling Embodied Appraisal in Humanoids : Grounding PAD space for Augmented Autonomy
- 2011
-
Ingår i: Proceedings of the Workshop on Standards in Emotion Modeling, 2011.
-
Konferensbidrag (övrigt vetenskapligt/konstnärligt)abstract
- A computational emotion architecture is presented which grounds an aspect of an appraisal theoretic architecture in energy related processes. The incorporation of an energy constraint on emotional-cognitive behaviour allows greater potential for autonomous agency when implemented on a physical (NAO) robot platform. In this paper we present an algorithm that enables metabolic grounding of the arousal component of the PAD emotion space used in the architecture. We describe an exemplar problem that abstracts variables and performance criteria relevant to service robotics applications. Future work on further integration based on neurobiological grounding is discussed as well as means by which the exemplar scenario may be scaled up to more realistic service robotics based scenarios.
|
|
| 5. |
- Lee, Gauss, et al.
(författare)
-
Modelling Early Infant Walking : Testing a Generic CPG Architecture on the NAO Humanoid
- 2011
-
Ingår i: IEEE International Conference on Development and Learning (ICDL), 2011. - : IEEE conference proceedings. - 9781612849898 ; , s. 1-6
-
Konferensbidrag (refereegranskat)abstract
- In this article, a simple CPG network is shown to model early infant walking, in particular the onset of independent walking. The difference between early infant walking and early adult walking is addressed with respect to the underlying neurophysiology and evaluated according to gait attributes. Based on this, we successfully model the early infant walking gait on the NAO robot and compare its motion dynamics and performance to those of infants. Our model is able to capture the core properties of early infant walking. We identify differences in the morphologies between the robot and infant and the effect of this on their respective performance. In conclusion, early infant walking can be seen to develop as a function of the CPG network and morphological characteristics.
|
|
| 6. |
- Li, Cai, et al.
(författare)
-
A novel approach to locomotion learning: Actor-Critic architecture using central pattern generators and dynamic motor primitives
- 2014
-
Ingår i: Frontiers in Neurorobotics. - : Frontiers. - 1662-5218. ; 8
-
Tidskriftsartikel (refereegranskat)abstract
- In this article, we propose an architecture of a bio-inspired controller that addresses the problem of learning different locomotion gaits for different robot morphologies. The modeling objective is split into two: baseline motion modeling and dynamics adaptation. Baseline motion modeling aims to achieve fundamental functions of a certain type of locomotion and dynamics adaptation provides a "reshaping" function for adapting the baseline motion to desired motion. Based on this assumption, a three-layer architecture is developed using central pattern generators (CPGs, a bio-inspired locomotor center for the baseline motion) and dynamic motor primitives (DMPs, a model with universal "reshaping" functions). In this article, we use this architecture with the actor-critic algorithms for finding a good "reshaping" function. In order to demonstrate the learning power of the actor-critic based architecture, we tested it on two experiments: (1) learning to crawl on a humanoid and, (2) learning to gallop on a puppy robot. Two types of actor-critic algorithms (policy search and policy gradient) are compared in order to evaluate the advantages and disadvantages of different actor-critic based learning algorithms for different morphologies. Finally, based on the analysis of the experimental results, a generic view/architecture for locomotion learning is discussed in the conclusion.
|
|
| 7. |
|
|
| 8. |
- Li, Cai, et al.
(författare)
-
Crawling Posture Learning in Humanoid Robots using a Natural-Actor-Critic CPG Architecture
- 2013
-
Ingår i: Advances in Artificial Life, ECAL 2013, Proceedings of the Twelfth European Conference on the Synthesis and Simulation of Living Systems. - : MIT Press. ; , s. 1182-1190
-
Konferensbidrag (refereegranskat)abstract
- In this article, a four-cell CPG network, exploiting sensory feedback, is proposed in order to emulate infant crawling gaits when utilized on the NAO robot. Based on the crawling model, the positive episodic natural-actor-critic architecture is applied to learn a proper posture of crawling on a simulated NAO. By transferring the learned results to the physical NAO, the transferability from simulation to physical world is discussed. Finally, a discussion pertaining to locomotion learning based on dynamic system theory is given in the conclusion.
|
|
| 9. |
- Li, Cai, et al.
(författare)
-
DMPs based CPG Actor Critic: A Method for Locomotion Learning
- 2014
-
Annan publikation (övrigt vetenskapligt/konstnärligt)abstract
- In this article, a dynamic motor primitives (DMPs) based CPG-Actor-Critic is proposed to enable locomotion learning on a humanoid (the NAO robot) and a puppy robot (the ghostdog robot). In order to model two types of locomotion with one architecture, a novel application of an existing method to designa CPG architecture for learning locomotion. The method is to a) have an architectural base (4-cell CPG) and, b) have a learning component which is based on an existing method for designing DMPs. Learning locomotion here concerns gait emergence in relation to the robot’s body and prior knowledge. The focus of this article will be on two types of locomotion: crawling on ahumanoid and running on a puppy robot. On the two robots with two different morphologies, our method and architecture can make the robots learn by itself. We also compare the performance with respect to two state-of-the-art reinforcement learning algorithms with provided particular instantiations of ourDMPs-based CPG-Actor-Critic architecture. Finally, based on the analysis of the experimental results, a generic view/architecture for locomotion learning is discussed and introduced in the conclusion.
|
|
| 10. |
|
|
