Uploaded March 2020 | Updated September 2026, 1 hour ago

---

Demonstration of using the augmented-reality (AR) capabilities of a mobile device to teleoperate a manipulator between the Pittsburgh, PA and Salzburg, Austria (7000 km distance).

The connection between the mobile device and the arm was done over a simple VPN, and video was done over Skype.

The code running in this video is a stock example for our arm kits in GitHub:

Python:
github.com/HebiRobotics/hebi-python-examples/blob/master/kits/arm/ex_mobile_device_control.py

C++:
github.com/HebiRobotics/hebi-cpp-examples/blob/hardik/arm_examples_2/kits/arm/example_AR_kit.cpp

Matlab:
github.com/HebiRobotics/hebi-matlab-examples/blob/master/kits/arms/ex_mobile_device_control.m

The mobile device (in this case an iPhone7) is running the free HEBI Mobile I/O App:

iOS:
https://itunes.apple.com/gb/app/hebi-...

Android:
https://play.google.com/store/apps/de...


For more information please visit:
hebirobotics.com
docs.hebi.us
github.com/HebiRobotics


Music:
Twelfth Street Rag - Duke Ellington and His Orchestra
Recorded 1922 (public domain)