Running Embedding Processing for AI Search at Scale | Notion + Anyscale @anyscale
Running Embedding Processing for AI Search at Scale | Notion + Anyscale  @anyscale
Uploaded November 2026 | Updated November 2026, 3 hours ago
Mickey Liu, Software Engineer at Notion, shares how the company leverages the Ray Data library on Anyscale to process terabytes of customer data and generate embedding vectors for their AI search product. By moving away from Spark, Notion resolved scalability bottlenecks and moved to a single pipeline that supports heterogeneous compute across CPU and GPU workloads. Partnering with Anyscale allowed Notion to reduce cloud bills, lower infrastructure overhead, and seamlessly scale prototypes into production for millions of customers.

đź”— More stories: anyscale.com/customers

đź”— Subscribe: youtube.com/c/anyscale

đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Running Embedding Processing for AI Search at Scale | Notion + AnyscaleServing vLLM on Agentic Production Workloads | Inferact | Ray Summit 2026Cost-Effective RL Post-Training with Ray and AWS Trainium | AWS + Anyscale | Ray Summit 2026Ray Serve: Advancing scalability and flexibility | Ray Summit 2025Trillion-Token Pretraining | Adyen | Ray Summit 2026Running Ray in Production: Google’s Guide to Operators & Observability | Ray Summit 2025From Agents to Action: Scaling Agentic AI with Ray on Intel Xeon | Intel | Ray Summit 2026Building an AI Science Factory | Andrew Beam (Lila Sciences) | Ray Summit 2026GLM-5 RL Training with vLLM | Prime Intellect | Ray Summit 2026Accelerating vLLM with LMCache | Ray Summit 2025Ray History Server: Observability for Ephemeral K8s Clusters | KubeRay | Ray Summit 2026SQL or Python? Why It’s the Wrong Question in the AI Era | Ray Summit 2025
Anyscale |

Running Embedding Processing for AI Search at Scale | Notion + Anyscale

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER