Uploaded March 2026 | Updated September 2026, 2 weeks ago
Directly integrating LLM models into Go applications allows developers to run local AI inference directly inside production systems. In this talk, Bill Kennedy demonstrates how Go developers can run hardware accelerated local inference using llama.cpp, embedding large language models directly into their applications.
Presented at FOSDEM 2026 in Brussels during the AI Plumbers (un)conference, this session explores practical approaches for running large language models locally and integrating AI capabilities into modern backend systems.
Instead of relying entirely on external APIs or cloud hosted models, Go teams can integrate local inference directly into their services. This approach offers greater control over performance, infrastructure cost, and data privacy while enabling new intelligent features inside production applications.
---
What You Will Learn
• How to run large language models locally inside Go applications
• How hardware acceleration improves local AI inference performance
• How llama.cpp enables efficient local LLM inference
• Practical approaches for integrating AI features into backend systems
• Patterns for embedding AI capabilities into production Go services
This session is especially useful for:
• Go developers exploring AI integration
• Backend engineers building AI enabled systems
• Teams interested in running large language models locally
• Developers evaluating local inference versus cloud AI APIs
---
About FOSDEM
FOSDEM one of the largest open source software conferences in Europe, bringing together developers and engineers to share advances across infrastructure, systems programming, and open source technologies.
---
Learn Go with Ardan Labs
If you want to deepen your expertise in Go and modern backend development, explore professional training from Ardan Labs.
Training programs available in:
• Go
• Kubernetes
• Rust
Learn more: ardanlabs.com/training
---
Connect with Ardan Labs
Website: ardanlabs.com
X: https://x.com/ardanlabs
LinkedIn: linkedin.com/company/ardanlabs
#golang #llm #ai #llamaCPP #LocalInference #goprogramming #softwareengineering
Directly integrating LLM models into Go applications allows developers to run local AI inference directly inside production systems. In this talk, Bill Kennedy demonstrates how Go developers can run hardware accelerated local inference using llama.cpp, embedding large language models directly into their applications.
Presented at FOSDEM 2026 in Brussels during the AI Plumbers (un)conference, this session explores practical approaches for running large language models locally and integrating AI capabilities into modern backend systems.
Instead of relying entirely on external APIs or cloud hosted models, Go teams can integrate local inference directly into their services. This approach offers greater control over performance, infrastructure cost, and data privacy while enabling new intelligent features inside production applications.
---
What You Will Learn
• How to run large language models locally inside Go applications
• How hardware acceleration improves local AI inference performance
• How llama.cpp enables efficient local LLM inference
• Practical approaches for integrating AI features into backend systems
• Patterns for embedding AI capabilities into production Go services
This session is especially useful for:
• Go developers exploring AI integration
• Backend engineers building AI enabled systems
• Teams interested in running large language models locally
• Developers evaluating local inference versus cloud AI APIs
---
About FOSDEM
FOSDEM one of the largest open source software conferences in Europe, bringing together developers and engineers to share advances across infrastructure, systems programming, and open source technologies.
---
Learn Go with Ardan Labs
If you want to deepen your expertise in Go and modern backend development, explore professional training from Ardan Labs.
Training programs available in:
• Go
• Kubernetes
• Rust
Learn more: ardanlabs.com/training
---
Connect with Ardan Labs
Website: ardanlabs.com
X: https://x.com/ardanlabs
LinkedIn: linkedin.com/company/ardanlabs
#golang #llm #ai #llamaCPP #LocalInference #goprogramming #softwareengineering
