Uploaded May 2018 | Updated September 2026, 3 weeks ago
ICRA 2018 Spotlight Video
Interactive Session Thu AM Pod J.4
Authors: Pahic, Rok; Gams, Andrej; Ude, Ales; Morimoto, Jun
Title: Deep Encoder-Decoder Networks for Mapping Raw Images to Dynamic Movement Primitives
Abstract:
In this paper we propose a new approach for learning perception-action couplings. We show that by collecting a suitable set of raw images and the associated movement trajectories, a deep encoder-decoder network can be trained that takes raw images as input and outputs the corresponding dynamic movement primitives. We propose suitable cost functions for training the network and describe how to calculate their gradients to enable effective training by back-propagation. We tested the proposed approach both on a synthetic dataset and on a widely used MNIST database to generate handwriting movements from raw images of digits. The calculated movements were also applied for digit writing with a real robot.
ICRA 2018 Spotlight Video
Interactive Session Thu AM Pod J.4
Authors: Pahic, Rok; Gams, Andrej; Ude, Ales; Morimoto, Jun
Title: Deep Encoder-Decoder Networks for Mapping Raw Images to Dynamic Movement Primitives
Abstract:
In this paper we propose a new approach for learning perception-action couplings. We show that by collecting a suitable set of raw images and the associated movement trajectories, a deep encoder-decoder network can be trained that takes raw images as input and outputs the corresponding dynamic movement primitives. We propose suitable cost functions for training the network and describe how to calculate their gradients to enable effective training by back-propagation. We tested the proposed approach both on a synthetic dataset and on a widely used MNIST database to generate handwriting movements from raw images of digits. The calculated movements were also applied for digit writing with a real robot.
