Unsupervised Learning of Hierarchical Models for Hand-Object Interactions Using Tactile Glove @ICRA-cg8kk
Unsupervised Learning of Hierarchical Models for Hand-Object Interactions Using Tactile Glove  @ICRA-cg8kk
Uploaded May 2018 | Updated November 2026, 1 day ago
ICRA 2018 Spotlight Video
Interactive Session Wed PM Pod C.1
Authors: Xie, Xu; Liu, Hangxin; Edmonds, Mark; Gao, Feng; Qi, Siyuan; Zhu, Yixin; Rothrock, Brandon; Zhu, Song-Chun
Title: Unsupervised Learning of Hierarchical Models for Hand-Object Interactions Using Tactile Glove

Abstract:
Contact forces of the hand are visually unobservable, but play a crucial role in understanding hand-object interactions. In this paper, we propose an unsupervised learning approach for manipulation event segmentation and manipulation event parsing. The proposed framework incorporates hand pose kinematics and contact forces using a low-cost easy-to-replicate tactile glove. We use a temporal grammar model to capture the hierarchical structure of events, integrating extracted force vectors from the raw sensory input of poses and forces. The temporal grammar is represented as a temporal And-Or graph (T-AOG), which can be induced in an unsupervised manner. We obtain the event labeling sequences by measuring the similarity between segments using the Dynamic Time Alignment Kernel (DTAK). Experimental results show that our method achieves high accuracy in manipulation event segmentation, recognition and parsing by utilizing both pose and force data.
Unsupervised Learning of Hierarchical Models for Hand-Object Interactions Using Tactile GloveShaping in Practice: Training Wheels to Learn Fast Hopping Directly in HardwareRecognizing Geometric Constraints in Human Demonstrations Using Force and Position SignalsRequirements Based Design and End-To-End Dynamic Modeling of a Robotic Tool for Vitreoretinal SurgerReinforcement Learning of Depth Stabilization with a Micro Diving AgentSafe and Efficient Human-Robot Collaboration Part I: Estimation of Human Arm MotionsDynamic Reconfiguration of Mission Parameters in Underwater Human-Robot CollaborationDisturbance Rejection in Multi-DOF Local Magnetic Actuation for Robotic Abdominal SurgeryEvaluating the Quality of Non-Prehensile Balancing GraspsPerception-aware Receding Horizon Navigation for MAVsObject Detection for Cattle Gait TrackingEchinoderm-inspired Tube Feet for Robust Robot Locomotion and Adhesion
ICRA 2018 |

Unsupervised Learning of Hierarchical Models for Hand-Object Interactions Using Tactile Glove

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER