Uploaded April 2025 | Updated September 2026, 2 weeks ago
In this video, I walk through how to combine the simplicity of Ollama with the massive flexibility of Hugging Face models—so you can easily run almost any model locally with full control.
We talk about:
• How to Run Hugging Face Models in Ollama:
Step-by-step instructions on downloading .gguf model files from Hugging Face, creating a simple Modelfile, and running them inside Ollama just like any native model—with a single command.
• Customizing Prompts and Behavior Using Modelfiles:
How to structure your Modelfile to include system prompts, user templates, response templates, and more. Whether you want something minimal or fully tricked out, you have complete control.
• Why It Matters for Fiction and Other Creative Use Cases:
Many open-source models on Hugging Face are uncensored and ideal for writing fiction or handling nuanced topics. This setup gives you the power to choose models that best fit your use case—without guardrails getting in the way.
Subscribe to the newsletter at:
danielmiessler.com/subscribe
Join the UL community at:
danielmiessler.com/upgrade
Follow on X:
https://x.com/danielmiessler
Follow on LinkedIn:
linkedin.com/in/danielmiessler
In this video, I walk through how to combine the simplicity of Ollama with the massive flexibility of Hugging Face models—so you can easily run almost any model locally with full control.
We talk about:
• How to Run Hugging Face Models in Ollama:
Step-by-step instructions on downloading .gguf model files from Hugging Face, creating a simple Modelfile, and running them inside Ollama just like any native model—with a single command.
• Customizing Prompts and Behavior Using Modelfiles:
How to structure your Modelfile to include system prompts, user templates, response templates, and more. Whether you want something minimal or fully tricked out, you have complete control.
• Why It Matters for Fiction and Other Creative Use Cases:
Many open-source models on Hugging Face are uncensored and ideal for writing fiction or handling nuanced topics. This setup gives you the power to choose models that best fit your use case—without guardrails getting in the way.
Subscribe to the newsletter at:
danielmiessler.com/subscribe
Join the UL community at:
danielmiessler.com/upgrade
Follow on X:
https://x.com/danielmiessler
Follow on LinkedIn:
linkedin.com/in/danielmiessler
