FrameworkDesktop and IncusOS, a perfect combination for running LLMs locally by  Peter Smink @DevoxxForever
FrameworkDesktop and IncusOS, a perfect combination for running LLMs locally by  Peter Smink  @DevoxxForever
Uploaded April 2026 | Updated September 2026, 2 weeks ago
Please subscribe to our YouTube channel @ youtube.com/@DevoxxForever
Subscribe to LinkedIn @ linkedin.com/company/voxxed-days-amsterdam
Follow us on Twitter @ twitter.com/voxxedamsterdam

If your are seriously developing AI Applications, a framework desktop server running IncusOS is a must have.
I will discus the pro and cons of such a setup,
go through the setup process and issues I run into when setting it up and using it.

I will give a demo how to you can run your own AI application on a laptop that use AI models running on the Incus server.

key take aways
you have a guide how to setup your own configuration and what issues you can encounter
you have an good impressing how this setup can help you own AI development
a solution to run LLM locally for privacy reasons
a solution to run LLM locally on a GPU for performance
a solution to keep cost under control. If your application has many mcp tools the costs per call are high when using public AI's
a solution that can run LLM that do not fit in graphical cards
You are a devops and just want to see how a modern tools like Incus can be used for running any container or VM
You want to be eco-friendly, to control/reduce your own energy usage for running AI

Target audience:
AI developers, Devops, Anyone who wants to run LLMs locally in a relative efficient way.
FrameworkDesktop and IncusOS, a perfect combination for running LLMs locally by  Peter SminkThe Ultimate Showdown of Database Migration Tools by  Pasha Finkelshteyn & Mikhail PolivakhaHow to survive and thrive as a dev (team) in the exponential age of AI by Sander HoogendoornHow I built my own Intelligent Robot Arm from Scratch by Iulia FeroliTechnical Enshittification: Why Everything in IT is Horrible Right Now and How to Fix It by Baruch SFrom Shadows to Spotlight - How Swiss Post Performs Reliable ML Deployment by Giovanni DegiorgiGearing up to Java 25: Key Language Features by Venkat SubramaniamAI at Every Step: Why Are You Still Doing the Dev Cycle by Hand? by Daniël FloorDon’t Panic! A Guide to Keeping the Human Edge in a Universe of Instant Output by Janina SutterUn-observable AI is un-trustworthy AI  by  Annie FreemanWelcome to Voxxed Days Amsterdam 2026 - Opening (room 1)[VDBUH2026] Andrei Mihai & Bianca Bulbuc - How Agentic AI Empowers Creative Thinking
Devoxx |

FrameworkDesktop and IncusOS, a perfect combination for running LLMs locally by Peter Smink

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER