Uploaded August 2024 | Updated September 2026, 2 weeks ago

---

In this video, I run Arcee Nova 72B locally on my Mac with Open WebUI and Ollama.

⭐️⭐️⭐️ Don't forget to subscribe to be notified of future videos. Follow me on Medium at julsimon.medium.com or Substack at https://julsimon.substack.com. ⭐️⭐️⭐️

This is the same 3-bit version I used in youtu.be/n42AMXecd_A.

I ask the model to explain what the gradient and the hessian are: first the intuition, then the math, then a Python code example. Just a basic one-line prompt. See the result for yourself.

Offline work. Full privacy. No inference cost. Remind me why I need ChatGPT again 🤣

Arcee Nova: huggingface.co/arcee-ai/Arcee-Nova
Open WebUI: github.com/open-webui/open-webui
Ollama: github.com/ollama/ollama

#chatgpt #openai #python #ai #llm #slm #ollama #chatbot #opensource