Co-Learning of Task and Sensor Placement for Soft Robotics (Teaser) @AAmini
Co-Learning of Task and Sensor Placement for Soft Robotics (Teaser)  @AAmini
Uploaded March 2021 | Updated September 2026, 2 weeks ago
Unlike rigid robots which operate with compact degrees of freedom, soft robots must reason about an infinite dimensional state space. Mapping this continuum state space presents significant challenges, especially when working with a finite set of discrete sensors. Reconstructing the robot’s state from these sparse inputs is challenging, especially since sensor location has a profound downstream impact on the richness of learned models for robotic tasks. In this work, we present a novel representation for co-learning sensor placement and complex tasks. Specifically, we present a neural architecture which processes on-board sensor information to learn a salient and sparse selection of placements for optimal task performance. We evaluate our model and learning
algorithm on six soft robot morphologies for various supervised learning tasks, including tactile sensing and proprioception. We also highlight applications to soft robot motion subspace visualization and control. Our method demonstrates superior performance in task learning to algorithmic and human baselines while also learning sensor placements and latent spaces that are semantically meaningful.

Authors: Andrew Spielberg*, Alexander Amini*, Lillian Chin, Wojciech Matusik, and Daniela Rus
Published in: IEEE Robotics and Automation Letters (RA-L), with presentation in RoboSoft 2021.

OpenAccess (free) paper link: ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9345345
Full paper video: youtube.com/watch?v=cffniAE1RRk
Co-Learning of Task and Sensor Placement for Soft Robotics (Teaser)MIT 6.S191 (2024): Language Models and New FrontiersMIT 6.S191: LiDAR for Autonomous DrivingMIT 6.S191 (2018): Convolutional Neural NetworksMIT 6.S191 (2023): Convolutional Neural NetworksMIT 6.S191 (2024): Google - Generative AI for MediaMIT Introduction to Deep Learning (2023) | 6.S191MIT 6.S191 (2018): Issues in Image ClassificationMIT 6.S191: AI for ScienceMIT 6.S191 (2022): Deep Generative ModelingMIT 6.S191 (2022): Recurrent Neural Networks and TransformersMIT 6.S191: Deep Generative Modeling
Alexander Amini |

Co-Learning of Task and Sensor Placement for Soft Robotics (Teaser)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER