Uploaded May 2024 | Updated September 2026, 2 weeks ago
In this video, we'll be discussing the seamless migration of your applications from OpenAI models to Hugging Face's open-source alternatives. We'll cover the step-by-step process of deploying a Llama3 8B model on a Google Cloud Inference Endpoint and invoking it with the OpenAI client library. Additionally, we'll deploy a Zephyr 7B model on Amazon SageMaker and demonstrate how easily it can be integrated with the OpenAI Messages API. By the end of this video, you'll be equipped with the knowledge to unlock the full potential of open-source models, all without rewriting your existing code!
This video is perfect for data scientists, machine learning engineers, and developers looking to explore the benefits of open-source models and expand their ML engineering toolkit.
#OpenAI #HuggingFace #MLEngineering
⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at julsimon.medium.com or Substack at https://julsimon.substack.com. ⭐️⭐️⭐️
Notebooks
* gitlab.com/juliensimon/huggingface-demos/-/blob/main/inference-endpoints/llama3-8b-openai.ipynb
* gitlab.com/juliensimon/huggingface-demos/-/blob/main/sagemaker-openai/deploy_zephyr_openai.ipynb
Blog: huggingface.co/blog/tgi-messages-api
In this video, we'll be discussing the seamless migration of your applications from OpenAI models to Hugging Face's open-source alternatives. We'll cover the step-by-step process of deploying a Llama3 8B model on a Google Cloud Inference Endpoint and invoking it with the OpenAI client library. Additionally, we'll deploy a Zephyr 7B model on Amazon SageMaker and demonstrate how easily it can be integrated with the OpenAI Messages API. By the end of this video, you'll be equipped with the knowledge to unlock the full potential of open-source models, all without rewriting your existing code!
This video is perfect for data scientists, machine learning engineers, and developers looking to explore the benefits of open-source models and expand their ML engineering toolkit.
#OpenAI #HuggingFace #MLEngineering
⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at julsimon.medium.com or Substack at https://julsimon.substack.com. ⭐️⭐️⭐️
Notebooks
* gitlab.com/juliensimon/huggingface-demos/-/blob/main/inference-endpoints/llama3-8b-openai.ipynb
* gitlab.com/juliensimon/huggingface-demos/-/blob/main/sagemaker-openai/deploy_zephyr_openai.ipynb
Blog: huggingface.co/blog/tgi-messages-api
