Uploaded April 2026 | Updated November 2026, 1 day ago
In this clip from Bill's Ultimate AI Workshop, we uncover a crucial detail that model servers usually hide from you: the necessity of "projection files". If you want your vision model to process images or audio (and not just text) you must load a projection file alongside your standard model file.
Bill speaks about how software like Llama.cpp uses a special multimedia library called MTMD to process image bytes, and why failing to load the projection file means your model won't understand the images you feed it. Finally, he does a quick walkthrough of the "Files and Versions" tab on Hugging Face to help you pick the right formats for inference, explaining why you should stick to F16 and avoid massive F32 or training-specific BF16 files.
What you'll learn in this clip:
• Why vision models require both a model file and a projection file for image processing
• How the MTMD library in Llama.cpp handles multimedia bytes
• How to navigate Hugging Face repositories to find the correct projection files
• Which model file formats to choose for inference (F16) and which to avoid (F32, BF16)
---
Explore more from Ardan Labs
Online Courses: ardanlabs.com/education
Live Training Events: ardanlabs.com/live-training-events
Technical Blog: ardanlabs.com/blog
Github: github.com/ardanlabs
---
Connect with Ardan Labs
Website: ardanlabs.com
X: https://x.com/ardanlabs
LinkedIn: linkedin.com/company/ardanlabs
Kronk AI: kronkai.com
#llamacpp #huggingface #localai #machinelearning #softwaredevelopment #aivision #aiinference #ardanlabs
In this clip from Bill's Ultimate AI Workshop, we uncover a crucial detail that model servers usually hide from you: the necessity of "projection files". If you want your vision model to process images or audio (and not just text) you must load a projection file alongside your standard model file.
Bill speaks about how software like Llama.cpp uses a special multimedia library called MTMD to process image bytes, and why failing to load the projection file means your model won't understand the images you feed it. Finally, he does a quick walkthrough of the "Files and Versions" tab on Hugging Face to help you pick the right formats for inference, explaining why you should stick to F16 and avoid massive F32 or training-specific BF16 files.
What you'll learn in this clip:
• Why vision models require both a model file and a projection file for image processing
• How the MTMD library in Llama.cpp handles multimedia bytes
• How to navigate Hugging Face repositories to find the correct projection files
• Which model file formats to choose for inference (F16) and which to avoid (F32, BF16)
---
Explore more from Ardan Labs
Online Courses: ardanlabs.com/education
Live Training Events: ardanlabs.com/live-training-events
Technical Blog: ardanlabs.com/blog
Github: github.com/ardanlabs
---
Connect with Ardan Labs
Website: ardanlabs.com
X: https://x.com/ardanlabs
LinkedIn: linkedin.com/company/ardanlabs
Kronk AI: kronkai.com
#llamacpp #huggingface #localai #machinelearning #softwaredevelopment #aivision #aiinference #ardanlabs










