Hybrid RL + Imitation Learning for Robotics with Ray at RAI Institute @anyscale
Hybrid RL + Imitation Learning for Robotics with Ray at RAI Institute  @anyscale
Uploaded November 2025 | Updated November 2026, 2 hours ago
The nature of machine learning in robotics demands complex abstractions of hardware and training/simulation layers to use a combination of RL and IL (Imitation Learning). In this respect, policy learning for robotics rarely fits on one kind of machine. For instance, massive simulation parallelization with GPU physics and rendering in Isaac Lab demand RTX‑class GPUs, while policy training benefits from large VRAM and FLOPs. Over the past year we have built our infra on Ray that hides this hardware/software diversity and lets researchers focus on science, not sys‑admin.

Our platform offers:
- Unified orchestration – a single Ray workflow allows to train full state RL models that are used to train multi-task IL policy, and evaluation in simulation.
- Heterogeneous GPU scheduling – placement groups assign Isaac Lab simulators to RTX workers and gradient computation to A100/H100 trainers without manual mapping.
- Isolated deployment targets – the same job definition that trains a policy can package it into a lightweight Ray Serve micro‑service that runs next to the robot or on a nearby edge server, shielding control code from research churn.

During the live demo we will:
- Launch a hybrid RL‑IL run that automatically provisions both Nvidia-RTX GPUs and A100/H100 nodes.
- Watch Ray adapt the cluster as workloads shift from simulation to learning to evaluation.
- Deploy the resulting policy to an isolated runtime on the robot—ready for immediate testing.
Attendees will leave with practical design patterns for juggling simulator‑heavy and large‑scale network training inside one reproducible Ray ecosystem, plus insights on meeting real‑time robotics constraints while remaining GPU‑efficient.
Hybrid RL + Imitation Learning for Robotics with Ray at RAI InstituteVideo Action Models | mimic robotics | Ray Summit 2026How Runhouse Orchestrates Multi-Cluster Ray Workloads | Ray Summit 2025Scaling DSpark Training Using vLLM, Speculators and Mooncake | Red Hat | Ray Summit 2026How vLLM and Ray Work TogetherRight Resource, Right Job: Heterogeneous Ray Clusters on Amazon EKS | Robinhood | Ray Summit 2026SkyRL: Democratizing RL Training for Researchers | Anyscale | Ray Summit 2026Secure & Scalable AI on Ray + Kubernetes: Google’s Decoupled Agent Pattern | Ray Summit 2025vLLM TPU: A new unified-backend supporting Pytorch and JAX natively on TPU | Ray Summit 2025Hugging Face + vLLM: One Model Definition to Rule Them All | Ray Summit 2025TorchSpec: Speculative Decoding Training at Scale | Together AI | Ray Summit 2026Satellite Imagery to Machine-Readable Intelligence | Xoople | Ray Summit 2026
Anyscale |

Hybrid RL + Imitation Learning for Robotics with Ray at RAI Institute

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER