Uploaded April 2023 | Updated November 2026, 3 hours ago
Blog post: aqueducthq.com/post/building-ml-pipelines-with-open-llms
Large language models (LLMs) and other foundation models have made an unprecedented step forward in AI. Unfortunately, the infrastructure required to run these models is so overwhelmingly complex that only a few select companies have the requisite capabilities. Infrastructure challenges range from managing large amount of data, deploying complex pipelines, and managing compute services. In this talk, we will discuss:
- An overview of the infrastructure challenges of running LLMs in the cloud
- A demo/walkthrough of deploying an LLM on existing cloud infrastructure
- How Aqueduct seamlessly takes a LLM-powered workflow from prototype to production.
This meetup was hosted by AICamp at the Anyscale offices in San Francisco, CA on April 4, 2023. Our thanks to AICamp for organizing and the Anyscale team for hosting!
GitHub: github.com/aqueducthq/aqueduct
Slack: slack.aqueducthq.com
Blog post: aqueducthq.com/post/building-ml-pipelines-with-open-llms
Large language models (LLMs) and other foundation models have made an unprecedented step forward in AI. Unfortunately, the infrastructure required to run these models is so overwhelmingly complex that only a few select companies have the requisite capabilities. Infrastructure challenges range from managing large amount of data, deploying complex pipelines, and managing compute services. In this talk, we will discuss:
- An overview of the infrastructure challenges of running LLMs in the cloud
- A demo/walkthrough of deploying an LLM on existing cloud infrastructure
- How Aqueduct seamlessly takes a LLM-powered workflow from prototype to production.
This meetup was hosted by AICamp at the Anyscale offices in San Francisco, CA on April 4, 2023. Our thanks to AICamp for organizing and the Anyscale team for hosting!
GitHub: github.com/aqueducthq/aqueduct
Slack: slack.aqueducthq.com










