Uploaded July 2024 | Updated September 2026, 2 weeks ago
In this video, you will learn about Arcee-Scribe, a versatile 7.7-billion parameter chat model by Arcee.ai.
⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at julsimon.medium.com or Substack at https://julsimon.substack.com. ⭐️⭐️⭐️
Scribe excels across a wide range of benchmarks. It's our strongest model to date in terms of reasoning on the Big-Bench Hard (BBH) dataset, and we discovered it to be particularly adept at creative writing tasks.
The model is a merge of InternLM-2.5-chat with a custom InternLM finetune, incorporating both general and writing-specific data. It was built on Arcee Cloud and you can learn more at arcee.ai/product/arceecloud.
Here, I run 8-bit and 4-bit quantized versions on my M3 MacBook with llama.cpp, and test them with a couple of creative writing prompts. Excellent results and great speed :)
* Blog post: blog.arcee.ai/introducing-arcee-scribe-your-creative-writing-partner
* Model page: huggingface.co/arcee-ai/Arcee-Scribe-GGUF
* Llama.cpp: github.com/ggerganov/llama.cpp
* Prompts and results:
Marketing email: gist.github.com/juliensimon/dee6515a8380c39653cab180b735b78b
Customer conversation: gist.github.com/juliensimon/b80a55a182277d0ad82917688d1bf44a
00:00 Introduction
01:40 Introducing Arcee-Scribe
02:15 The Arcee.ai organization on Hugging Face
2:50 The Arcee-Scribe model family
5:20 Arcee-Scribe Q8 with llama.cpp: writing a marketing email
8:40 Writing a fictional customer conversation
11:04 Same examples with Arcee-Scribe Q4 :)
12:05 Why Small Language Models are exciting!
#ai #slm #llm #openai #chatgpt #opensource #huggingface
Sign up for Arcee Cloud at https://www.arcee.ai, and please follow Arcee.ai on LinkedIn to stay on top of the latest Small Language Model action! linkedin.com/company/99895334
tiktok: julien_simon_78
In this video, you will learn about Arcee-Scribe, a versatile 7.7-billion parameter chat model by Arcee.ai.
⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at julsimon.medium.com or Substack at https://julsimon.substack.com. ⭐️⭐️⭐️
Scribe excels across a wide range of benchmarks. It's our strongest model to date in terms of reasoning on the Big-Bench Hard (BBH) dataset, and we discovered it to be particularly adept at creative writing tasks.
The model is a merge of InternLM-2.5-chat with a custom InternLM finetune, incorporating both general and writing-specific data. It was built on Arcee Cloud and you can learn more at arcee.ai/product/arceecloud.
Here, I run 8-bit and 4-bit quantized versions on my M3 MacBook with llama.cpp, and test them with a couple of creative writing prompts. Excellent results and great speed :)
* Blog post: blog.arcee.ai/introducing-arcee-scribe-your-creative-writing-partner
* Model page: huggingface.co/arcee-ai/Arcee-Scribe-GGUF
* Llama.cpp: github.com/ggerganov/llama.cpp
* Prompts and results:
Marketing email: gist.github.com/juliensimon/dee6515a8380c39653cab180b735b78b
Customer conversation: gist.github.com/juliensimon/b80a55a182277d0ad82917688d1bf44a
00:00 Introduction
01:40 Introducing Arcee-Scribe
02:15 The Arcee.ai organization on Hugging Face
2:50 The Arcee-Scribe model family
5:20 Arcee-Scribe Q8 with llama.cpp: writing a marketing email
8:40 Writing a fictional customer conversation
11:04 Same examples with Arcee-Scribe Q4 :)
12:05 Why Small Language Models are exciting!
#ai #slm #llm #openai #chatgpt #opensource #huggingface
Sign up for Arcee Cloud at https://www.arcee.ai, and please follow Arcee.ai on LinkedIn to stay on top of the latest Small Language Model action! linkedin.com/company/99895334
tiktok: julien_simon_78
