Safety Guardrails for LLM-enabled Robots @KumarLabPenn
Safety Guardrails for LLM-enabled Robots  @KumarLabPenn
Uploaded March 2026 | Updated November 2026, 3 hours ago
Abstract:
Although the integration of large language models (LLMs) into robotics has unlocked transformative capabilities, it has also introduced significant safety concerns, ranging from average-case LLM errors (e.g., hallucinations) to adversarial jailbreaking attacks, which can produce harmful robot behavior in real-world settings. Traditional robot safety approaches do not address the contextual vulnerabilities of LLMs, and current LLM safety approaches overlook the physical risks posed by robots operating in real-world environments. To ensure the safety of LLM-enabled robots, we propose RoboGuard, a two-stage guardrail architecture. RoboGuard first contextualizes pre-defined safety rules by grounding them in the robot's environment using a root-of-trust LLM. This LLM is shielded from malicious prompts and employs chain-of-thought (CoT) reasoning to generate context-dependent safety specifications, such as temporal logic constraints. RoboGuard then resolves conflicts between these contextual safety specifications and potentially unsafe plans using temporal logic control synthesis, ensuring compliance while minimally violating user preferences. In simulation and real-world experiments that consider worst-case jailbreaking attacks, RoboGuard reduces the execution of unsafe plans from over 92% to below 3% without compromising performance on safe plans. We also demonstrate that RoboGuard is resource-efficient, robust against adaptive attacks, and enhanced by its root-of-trust LLM's CoT reasoning. These results demonstrate the potential of RoboGuard to mitigate the safety risks and enhance the reliability of LLM-enabled robots.

Project page: robo-guard.github.io
Paper: arxiv.org/abs/2503.07885
Safety Guardrails for LLM-enabled RobotsEVPeriscope: Extended Perception across Aerial and Ground Robots with Event-based Propeller Tracking4D Metric-Semantic Mapping for Persistent Orchard Monitoring: Method and DatasetATLAS Navigator: Active Task-driven LAnguage-embedded Gaussian SplattingLearning to Explore Indoor Environments using Autonomous Micro Aerial VehiclesAgriNeRF: Neural Radiance Fields for Agriculture in Challenging Lighting ConditionsDesign and Evaluation of Motion Planners for QuadrotorsSPINE: Online Semantic Planning for Missions with Incomplete Natural Language SpecificationsControl of Quadrotors using the Hopf Fibration on SO(3)Shape and Motion Control of a SwarmActively Resolving Contextual Uncertainty for Underspecified Tasks in Natural LanguageVision Transformers for End-to-End Vision-Based Quadrotor Obstacle Avoidance
Vijay Kumar |

Safety Guardrails for LLM-enabled Robots

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER