Developer resources to deploy and test Arcee models on AWS @juliensimonfr

Uploaded September 2024 | Updated September 2026, 2 weeks ago

In this video, you will learn about a collection of developer resources that make it easy to deploy Arcee models on Amazon SageMaker.

⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at julsimon.medium.com or Substack at https://julsimon.substack.com. ⭐️⭐️⭐️

- Notebooks to deploy from the Hugging Face hub
- Notebooks to deploy from AWS Marketplace listings
- CloudFormation templates to deploy from the Hugging Face hub, from your model packages, and from model artifacts in S3, with both the TGI and LMI+vLLM inference servers.

Github repository: github.com/arcee-ai/aws-samples

Please follow Arcee.ai on LinkedIn to stay on top of the latest Small Language Model action!

#ai #aws #slm #llm #openai #chatgpt #opensource #huggingface

Developer resources to deploy and test Arcee models on AWS

A fistful of dollars: fine-tune LLaMA 2 7B with QLoRA

LLMs from the trenches - Bias, risk management, cultural differences, and all that good stuff

Is it time to rethink how we engage with cultural nuances in AI?

Deep Dive: Hugging Face models on AWS AI Accelerators

LLMs from the trenches - Closed model builders have decided for you

Arcee Lite: Ultra-Fast Streaming Inference!

Hugging Face profite de lemballement pour lintelligence artificielle

Accelerating Stable Diffusion Inference on Intel CPUs with Hugging Face (part 2) 🚀 🚀 🚀

Comparing SLMs and LLMs with similarity metrics

3 Billion Parameters Used at 26 Billion Knowledge!