Uploaded April 2026 | Updated September 2026, 2 weeks ago
Vision language models like Gemma 4 are great at understanding images but terrible at counting objects. In this video, I combine Gemma 4 with Falcon Perception, a tiny 300M parameter segmentation model, inside an agentic loop to build a local vision system that can actually detect, count, and reason about objects accurately. The whole agentic loop is running on NVIDIA DGX Spark, which has enough memory to run both Gemma and Falcon Perception models.
github.com/PromtEngineer/Gemma4-Visual-Agent/tree/dgx-spark-gb10
huggingface.co/blog/tiiuae/falcon-perception
https://deepmind.google/models/gemma/
developer.nvidia.com/blog/bringing-ai-closer-to-the-edge-and-on-device-with-gemma-4
inspired by this post: https://x.com/MaziyarPanahi/status/2041139136644407653
My Dictation App: whryte.com
Website: engineerprompt.ai
RAG Beyond Basics Course:
prompt-s-site.thinkific.com/courses/rag
Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0
Let's Connect:
🦾 Discord: discord.com/invite/t4eYQRUcXB
☕ Buy me a Coffee: ko-fi.com/promptengineering
|🔴 Patreon: patreon.com/PromptEngineering
💼Consulting: calendly.com/engineerprompt/consulting-call
📧 Business Contact: engineerprompt@gmail.com
Become Member: tinyurl.com/y5h28s6h
💻 Pre-configured localGPT VM: bit.ly/localGPT (use Code: PromptEngineering for 50% off).
Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0
Vision language models like Gemma 4 are great at understanding images but terrible at counting objects. In this video, I combine Gemma 4 with Falcon Perception, a tiny 300M parameter segmentation model, inside an agentic loop to build a local vision system that can actually detect, count, and reason about objects accurately. The whole agentic loop is running on NVIDIA DGX Spark, which has enough memory to run both Gemma and Falcon Perception models.
github.com/PromtEngineer/Gemma4-Visual-Agent/tree/dgx-spark-gb10
huggingface.co/blog/tiiuae/falcon-perception
https://deepmind.google/models/gemma/
developer.nvidia.com/blog/bringing-ai-closer-to-the-edge-and-on-device-with-gemma-4
inspired by this post: https://x.com/MaziyarPanahi/status/2041139136644407653
My Dictation App: whryte.com
Website: engineerprompt.ai
RAG Beyond Basics Course:
prompt-s-site.thinkific.com/courses/rag
Signup for Newsletter, localgpt: https://tally.so/r/3y9bb0
Let's Connect:
🦾 Discord: discord.com/invite/t4eYQRUcXB
☕ Buy me a Coffee: ko-fi.com/promptengineering
|🔴 Patreon: patreon.com/PromptEngineering
💼Consulting: calendly.com/engineerprompt/consulting-call
📧 Business Contact: engineerprompt@gmail.com
Become Member: tinyurl.com/y5h28s6h
💻 Pre-configured localGPT VM: bit.ly/localGPT (use Code: PromptEngineering for 50% off).
Signup for Newsletter, localgpt:
https://tally.so/r/3y9bb0
