Uploaded September 2026 | Updated November 2026, 3 days ago
Maintaining a search index over hundreds of billions of web pages means constantly reprocessing derived artifacts, embeddings, extracted text, and search signals, as content changes. Off-the-shelf data warehouses couldn't meet Exa's need for column-level updates at petabyte scale.
At Ray Summit 2026, Lei Xu, CTO and co-founder of LanceDB, and Hubert Yuan, Software Engineer at Exa, walk through exa-d, Exa's data framework built on Lance and Ray Data: how dependency graphs drive execution, how fragment-level patching avoids write amplification, and how Ray Actors enable stateful model reuse.
You'll leave with patterns for derived-data pipelines at billion-document scale.
Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com
Maintaining a search index over hundreds of billions of web pages means constantly reprocessing derived artifacts, embeddings, extracted text, and search signals, as content changes. Off-the-shelf data warehouses couldn't meet Exa's need for column-level updates at petabyte scale.
At Ray Summit 2026, Lei Xu, CTO and co-founder of LanceDB, and Hubert Yuan, Software Engineer at Exa, walk through exa-d, Exa's data framework built on Lance and Ray Data: how dependency graphs drive execution, how fragment-level patching avoids write amplification, and how Ray Actors enable stateful model reuse.
You'll leave with patterns for derived-data pipelines at billion-document scale.
Liked this video? Check out other Ray Summit breakout session recordings: youtube.com/playlist?list=PLZNaJyYZRPdo
Subscribe to our YouTube channel to stay up-to-date on the future of AI: youtube.com/c/anyscale
đź”— Connect with us:
LinkedIn: linkedin.com/company/joinanyscale
X: https://x.com/anyscalecompute
Website: anyscale.com










