Uploaded July 2025 | Updated September 2026, 2 weeks ago
W&B Inference provides API and playground access to leading open-source foundation models, without additional overhead of dealing with multiple model providers or hosting on their own. In this demo, we'll walk you through how to leverage W&B Inference for prototyping and evaluating AI applications using popular open-source LLMs.
⏳Timestamps:
0:00 Introduction to W&B Inference
1:54 How to access open-source LLMs in Weave
2:17 Tracing LLM calls using the Weave SDK
3:24 Testing an open-source LLM using W&B Inference in the playground
4:08 Comparing Weave traces
5:44 Setting up an AI application and Weave Evaluations using open-source LLMs
6:39 Exploring AI application evaluation results in Weave
7:51 Conclusion and invitation to try W&B Weave
W&B Inference provides API and playground access to leading open-source foundation models, without additional overhead of dealing with multiple model providers or hosting on their own. In this demo, we'll walk you through how to leverage W&B Inference for prototyping and evaluating AI applications using popular open-source LLMs.
⏳Timestamps:
0:00 Introduction to W&B Inference
1:54 How to access open-source LLMs in Weave
2:17 Tracing LLM calls using the Weave SDK
3:24 Testing an open-source LLM using W&B Inference in the playground
4:08 Comparing Weave traces
5:44 Setting up an AI application and Weave Evaluations using open-source LLMs
6:39 Exploring AI application evaluation results in Weave
7:51 Conclusion and invitation to try W&B Weave
