Sensing Fine-Grained Hand Activity with Smartwatches @FiglabCMU
Sensing Fine-Grained Hand Activity with Smartwatches  @FiglabCMU
Uploaded May 2019 | Updated September 2026, 2 hours ago
Details: gierad.com/projects/handactivities
As philosopher Immanuel Kant argued, "the hand is the visible part of the brain." However, most prior work has focused on detecting whole-body activities, such as walking, running and bicycling. In this research, we explore the feasibility of sensing hand activities from commodity smartwatches, which are the most practical vehicle for achieving this vision. We show that our deep learning classification stack achieves 95.2% accuracy across 25 hand activities. Our work highlights an underutilized, yet highly complementary contextual channel that could unlock a wide range of promising applications.

Published at ACM CHI 2019.

Laput, G. and Harrison, C. 2019. Sensing Fine-Grained Hand Activity with Smartwatches. In Proceedings of the 37th Annual SIGCHI Conference on Human Factors in Computing Systems (Glasgow, UK, May 4 - 9, 2019). CHI '19. ACM, New York, NY. Paper 338, 13 pages.
Sensing Fine-Grained Hand Activity with SmartwatchesSynthetic Sensors: Towards General-Purpose SensingAuraSense (Yang Zhang - ACM UIST 2016)LRAir: Non-Contact Haptics Using Synthetic JetsDeus EM Machina: On-Touch Contextual Functionality for Smart IoT AppliancesAuraSense: Enabling Expressive Around-Smartwatch Interactions with Electric Field SensingPower-over-Skin: Full Body Wearables Powered By Intra-Body RF Energy (Presentation @ ACM UIST 2024)IMUPoser: Full-Body Pose Estimation using IMUs in Phones, Watches, and EarbudsSynthetic Sensors (Gierad Laput - ACM CHI 2017)SweepSense: Ad Hoc Configuration Sensing Using Reflected Swept-Frequency UltrasonicsCapAuth (ACM ITS 2015)Flat Panel Haptics: Embedded Electroosmotic Pumps for Scalable Shape Displays
Future Interfaces Group |

Sensing Fine-Grained Hand Activity with Smartwatches

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER