Scaling LLM Post-Training at Character.AI | Ray Summit 2025 @anyscale
Scaling LLM Post-Training at Character.AI | Ray Summit 2025  @anyscale
Uploaded November 2025 | Updated November 2026, 1 day ago
At Ray Summit 2025, Haoran Li from Character AI shares how the company powers its massive AI entertainment platform—serving tens of millions of users daily—using a fully open-source post-training stack built entirely on the Ray ecosystem.

Haoran next introduces Rayman, Character AI’s internal fine-tuning platform that accelerates model development velocity and significantly improves the training efficiency of large Mixture-of-Experts (MoE) models. Rayman brings together scalable distributed compute, efficient orchestration, and flexible experimentation—all built on open-source components.

Haoran also explains how Character AI leverages and adapts open-source RL libraries such as Verl to address the company’s unique reinforcement learning challenges, enabling rapid iteration and high-quality post-training for LLM-based interactive characters.

In this talk, she walks through the architecture of Rayman, the open-source projects that form the backbone of the system, the RL framework that drives model refinement, and the key ML challenges Character AI has overcome on its path to delivering state-of-the-art AI entertainment at global scale.

Attendees will gain practical insights into building scalable post-training pipelines, adapting RL for large consumer applications, and accelerating model improvement using Ray-based infrastructure.

Liked this video? Check out other Ray Summit breakout session recordings youtube.com/playlist?list=PLzTswPQNepXllnU0C36WtkC0dqkAoDulh

Subscribe to our YouTube channel to stay up-to-date on the future of AI! youtube.com/c/anyscale

🔗 Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Scaling LLM Post-Training at Character.AI | Ray Summit 2025Airbnbs LLM Evolution: Fine-Tuning with Ray | Ray Summit 2024Webinar: Getting Started with Distributed Training at ScaleHighly Compressed Gemma Models with Custom Quantization-Aware Training | DeepMind | Ray Summit 2026Multi-Modal Data Processing Pipelines for AI Systems | Anyscale | Ray Summit 2026Ray Across the Stack Fine Tuning Qwen and Serving 3D Generation at Autodesk with AWS Trainium and InBuilding AV 3.0 for Autonomous Trucking | Felix Heide (Torc Robotics) | Ray Summit 2026Scaling PyTorch Training with Ray Data on Ubers Michelangelo AI Platform | Uber | Ray Summit 2026How Alibaba Cloud Accelerates AI Pipelines with AnalyticDB Ray | Ray Summit 2025Adapting Ray to Scale RL Training for Nemotron | NVIDIA | Ray Summit 2026High-Performance LLM Serving on Intel: vLLM for XPU, HPU & CPU | Ray Summit 2025LeRobot Dataset v3.0: Scaling Reads with Ray | Anyscale | Ray Summit 2026
Anyscale |

Scaling LLM Post-Training at Character.AI | Ray Summit 2025

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER