KIMLAB (Kinetic Intelligent Machine LAB) | [CWBB2022] FRIDA: Framework and Robotics Initiative for Developing Arts @KIMLAB2020 | Uploaded December 2022 | Updated October 2024, 1 hour ago.
FRIDA: Framework and Robotics Initiative for Developing Arts
FRIDA: Framework and Robotics Initiative for Developing Arts
![[CWBB2022] FRIDA: Framework and Robotics Initiative for Developing Arts](https://i.ytimg.com/vi/ATPHmpt4JQs/hqdefault.jpg "[CWBB2022] FRIDA: Framework and Robotics Initiative for Developing Arts
FRIDA: Framework and Robotics Initiative for Developing Arts")
![[KIMLAB x PSYONIC] PAPRAS:Orthrus playing Captain America](https://i.ytimg.com/vi/B1FqiZuX_uc/hqdefault.jpg "[KIMLAB x PSYONIC] PAPRAS:Orthrus playing Captain America
[KIMLAB x PSYONIC] PAPRAS:Orthrus playing Captain America")
![[CWBB2022] Build a Punyo Gripper](https://i.ytimg.com/vi/D6K7vQilUHw/hqdefault.jpg "[CWBB2022] Build a Punyo Gripper
Title: Build a Punyo Gripper
Speaker: Alex Alspach, TRI
Abstract:
Toyota Research Institute (TRI) is excited to release the build instructions and design files for our Punyo Bubble Gripper so that our friends and colleagues can test our technology, improve upon it, and take us closer to building robotic assistants for the home!
https://punyo.tech
Want to work with us? We are developing a demonstration kit to share with partners. If youd like to receive updates, please let us know at https://punyo.tech/survey.
Question or comments? Feel free to message us at punyo-info@tri.global
The Punyo project information is distributed using the Creative Commons Attribution-NonCommercial 4.0 International license.")
![[2023 Weekly KIMLAB] MOMOs Tree Topping Travel](https://i.ytimg.com/vi/FENfp1-bct8/hqdefault.jpg "[2023 Weekly KIMLAB] MOMOs Tree Topping Travel
Embark on MOMO(Mobile Object Manipulation Operator)s thrilling quest to ignite joy and excitement! Watch as MOMO skillfully places the tree topper, ensuring that every KIMLAB members holiday season is filled with happiness and brightness. Happy Holidays! 🎄🌟
-MOMO
https://youtu.be/OvcFSEICq9w?feature=shared")
![[2023 Weekly KIMLAB] Specifying Target Objects in Teleoperation Using Speech and Natural Eye Gaze](https://i.ytimg.com/vi/FWkA-QXKoic/hqdefault.jpg "[2023 Weekly KIMLAB] Specifying Target Objects in Teleoperation Using Speech and Natural Eye Gaze
In this study, we propose a new intent detection framework to teleoperate robotic arms based on human speech and natural eye gaze. Our framework applies instance segmentation on the robots camera image and predicts the humans intended object through matching eye-gaze data, instance masks, instance classes, and transcribed words.
***This work will be presented at the IEEE-RAS Humanoids 2023 in Austin.
https://2023.ieee-humanoids.org/
Yu-Chen (Johnny) Chang, Nitish Gandi, Kazuki Shin, Ye-Ji Mun, Katherine Driggs-Campbell, Joohyung Kim, ”Specifying Target Objects in Robot Teleoperation Using Speech and Natural Eye Gaze,” IEEE-RAS International Conference on Humanoid Robots, December 2023")
![[2023 Weekly KIMLAB] Exploring the Capabilities of a General-Purpose Robotic Arm in Chess Gameplay](https://i.ytimg.com/vi/GsLxrXSdOqA/hqdefault.jpg "[2023 Weekly KIMLAB] Exploring the Capabilities of a General-Purpose Robotic Arm in Chess Gameplay
As the field of human-robot collaboration continues to grow and autonomous general-purpose service robots become more prevalent, robots need to obtain situational awareness and handle tasks with a limited field of view and workspace. Addressing these challenges, KIMLAB and Prof. Yong Jae Lee at the University of Wisconsin-Madison utilize the game of chess as a testbed, employing a general-purpose robotic arm.
To achieve successful robotic manipulation in playing board games like chess, the robot must follow game rules and prioritize human safety, all while operating in a limited workspace with field-of-view constraints. A pipeline is proposed that considers the rules of the chess game, the constraints of the robot, and environmental conditions to generate valid moves and countermoves. To validate the algorithm, experiments were conducted with the robotic platform, and the parameters of the system were tuned. The proposed algorithm achieved competitive performance, with an average robot turn success rate of 91.94%. This research demonstrates the potential of a general-purpose robot with a single camera to engage safely in competitive tasks with humans, even with these constraints.
***This work will be presented at the IEEE-RAS Humanoids 2023 in Austin.
https://2023.ieee-humanoids.org/
Kazuki Shin, Sankalp Yamsani, Roman Mineyev, Hongyu Chen, Nitish Gandi, Yong Jae Lee, Joohyung Kim, ”Exploring the Capabilities of a General-Purpose Robotic Arm in Chess Gameplay,” IEEE-RAS International Conference on Humanoid Robots, December 2023")
![[2023 Weekly KIMLAB] Interactive Robotic Backpack with PAPRAS](https://i.ytimg.com/vi/NsQyspbpdVE/hqdefault.jpg "[2023 Weekly KIMLAB] Interactive Robotic Backpack with PAPRAS
The Weekly KIMLABs second video unveils PAPRAS:Backpack.
While movies and animations often showcase characters and superheroes with additional limbs, bringing such concepts into the real world involves a multitude of considerations. In this video, we delve into the development of a skeleton estimator utilizing a multi-IMU system and an interactive motion controller designed for our robotic backpack.
***KIMLAB is gearing up to unleash the PAPRAS: Backpack at the Demo Expo during IROS 2023!!!
The Demo Expo will be rocking from 3:30-5:00 pm on Wednesday, October 4, 2023, in the Exhibition Hall. Be sure to track us down and witness the live demo at IROS2023.
Chaerim Moon, Sean Taylor, Kevin G Gim, Sankalp Yamsani, Kazuki Shin, Kyungseo Park, Joohyung Kim, Robotic Backpack System with Pluggable Supernumerary Limbs, Demonstration Sessions, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2023), 2023
The backpack hardware was created in 2021, and there are additional video clips showcasing this system.
https://youtu.be/byzNdOhueeQ
https://youtu.be/5O2HC9aiIYU
https://youtu.be/uq5AF7WDP1Y")
