Daves Garage
NVIDIAs $249 Secret Weapon for Edge AI - Jetson Orin Nano Super: Driveway Monitor
updated
If you're into tech history, retro computing, or just curious about how cyberwarfare can impact the real world, be sure to subscribe and hit the notification bell! And if you have an interest in autism-related topics, don’t forget to check out my book on Amazon—link in the description. amzn.to/3zBinWM
Dave's Attic - Friday 4PM Podcast - youtube.com/@UCtb6a_CnmGbSns9G8W2Ny0w
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Dave's Attic - Friday 4PM Podcast - youtube.com/@UCtb6a_CnmGbSns9G8W2Ny0w
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
For full details on wiringPi, which is needed to run this example, see their github: github.com/WiringPi/WiringPi
Basic steps to install it:
git clone github.com/WiringPi/WiringPi.git
cd WiringPi
./build debian
cd debian-template
sudo apt install wiringpifilewith.deb [Filename varies, subst your .deb file]
Dave's Attic - Friday 4PM Podcast - youtube.com/@UCtb6a_CnmGbSns9G8W2Ny0w
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Without Conscience Book: amzn.to/3Y5sEmh
Dave's Attic - Friday 4PM Podcast - youtube.com/@UCtb6a_CnmGbSns9G8W2Ny0w
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Dave's Attic - Friday 4PM Podcast - youtube.com/@UCtb6a_CnmGbSns9G8W2Ny0w
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Whether you're curious about autism or just enjoy hearing stories from real life, this episode of Dave’s Garage has something for you. If you’ve ever felt like people just don’t get you, or you're trying to better understand someone on the spectrum, check it out! Plus, if you like today’s discussion, there’s more in my book, available on Amazon amzn.to/3XFDfnR
Subscribe to "Dave's Attic" for the weekly Q&A: youtube.com/@UCtb6a_CnmGbSns9G8W2Ny0w
Twitter: davepl1968
Facebook: fb.com/davepl
I’m doing something that’s never been done before: we’re going to run a ChatGPT-style large language model locally on a wide range of hardware, from a $50 Raspberry Pi 4 all the way up to a $50,000 Dell AI workstation with dual Nvidia 6000 Ada cards.
If you saw my last video, you know I caught some heat for using top-tier hardware and running everything in WSL on Windows. This time, I’m doing things differently. We’re starting small and budget-friendly—no Linux shenanigans—and testing out local inference on everything from a Pi to a high-performance mini PC, a gaming rig, an M2 Mac Pro, and, of course, that beast of a Dell workstation.
Along the way, I’ll show you how to install Ollama on Windows, and we’ll compare how well each machine can handle models like Llama 3.1 and even the monstrous 405-billion parameter model. Which system will shine? Which one will falter? Can a Raspberry Pi even handle a large language model at all? And what happens when we push the $50,000 workstation to its limit?
If you’ve ever wondered what it takes to run a large language model locally, or just want to see how different hardware stacks up, this episode is for you! Be sure to stick around to the end for some surprising results.
💻 Hardware tested in this episode:
Raspberry Pi 4 (8GB RAM)
Orion Herk Mini PC (Ryzen 9 7940HS)
Desktop Gaming PC (Threadripper 3970X & Nvidia 4080)
Apple M2 Mac Pro
Dell Threadripper Workstation (96 cores & Nvidia 6000 Ada)
Check out Dave’s Attic for behind-the-scenes Q&A on episodes like this one.!
HTTP://youtube.com/@UCtb6a_CnmGbSns9G8W2Ny0w
Follow me on Facebook for daily updates!
HTTP://fb.com/davepl
Twitter: @davepl1968davepl1968
Subscribe to "Dave's Attic" for the weekly Q&A: youtube.com/@UCtb6a_CnmGbSns9G8W2Ny0w
For my book on the autism spectrum, check out: amzn.to/3XFDfnR
Image Credit: Medium.com
Helpful links and tips:
Install ollama:
curl -fsSL ollama.com/install.sh | sh
ollama serve
WSL Kernel Update Package: learn.microsoft.com/en-us/windows/wsl/install-manual#step-4---download-the-linux-kernel-update-package
Run the UI Docker Container:
Run UI with Docker:
docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama
Join Dave as we explore one of the most shocking and tragic stories in medical history - the story of the Therac-25, a radiation therapy machine that went horribly wrong. In this episode, we'll delve into the fascinating yet disturbing tale of how a seemingly advanced technology ended up causing catastrophic harm to countless patients.
We'll examine the Therac-25's inner workings, explore the flaws in its software and design, and discuss the devastating consequences of its malfunctions. You'll hear the heart-wrenching stories of patients who suffered from radiation overdoses, and learn about the heroic efforts of medical professionals who worked tirelessly to treat these victims.
This episode is a must-watch for anyone interested in technology, medicine, or the human side of innovation gone wrong. So sit back, relax, and get ready to uncover one of the most chilling tales in the history of science and medicine!
Thanks to BobT for the episode idea!
ChatGPT's New Model "01": The duo discusses OpenAI's latest ChatGPT model, "01". Dave shares his initial impressions, noting its improved reasoning capabilities and how it checks its answers through self-analysis.
Elon Musk's Colossus Supercomputer: They explore Elon Musk's new AI supercluster, Colossus, equipped with 100,000 Nvidia H100 and H200 GPUs. They speculate on its potential uses for X.AI, Grok, and Tesla's Optimus robot.
Apple's Latest Releases:
AirPods Updates: Discussion on the new AirPods and AirPods Pro 2 with USB-C charging, improved fit, and the H2 chip. Notably, they highlight the addition of medical-grade hearing aid features.
Apple Watch Series 10: They talk about its larger, thinner design, brighter display, new S10 chip, and the introduction of sleep apnea detection.
Hearing Protection and Health: Dave shares his experiences using AirPods for noise cancellation at concerts and the importance of hearing preservation. Glen adds insights on custom earplugs and personal health routines.
Viewer Questions:
Favorite Commodore PET Game: Dave reminisces about "Invaders" and discusses the rare "Fat 40" PET model.
Releasing Commodore 64 Games: He explains why he can't release the Commodore 64 version of "Tour de Force" due to licensing issues.
Staying in the U.S.: Dave talks about his reasons for remaining in the United States instead of moving back to Canada, touching on taxation and personal circumstances.
ASD Diagnosis Testing: He shares details about the in-depth testing process he underwent for his Autism Spectrum Disorder diagnosis.
Additional Discussions:
The complexities of managing device charging routines with new health features.
Reflections on old comic book ads and childhood nostalgia.
The importance of cybersecurity and proactive measures individuals can take.
Errata: Upgrading a 40-col PET 8032 to 80-column may involve changing the editor ROM as well, not just the RAM and jumpers!
Dave's Attic - Friday 4PM Podcast - youtube.com/@UCtb6a_CnmGbSns9G8W2Ny0w
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Thanks to Curious Marc and the Facebook PDP-11 group for the PDP-11 footage/images!
In this episode:
• The Hunt for Vintage Tech: Dave and Glen discuss the dwindling availability of classic tech like pay phones and how the world of vintage tech collecting is evolving.
• PDP-11 Restoration Update: Dave shares the latest on his ongoing PDP-11/73 restoration project, including unexpected challenges, component troubleshooting, and what it takes to keep a vintage machine alive.
• The Evolution of Pay Phones: Did you know pay phones are still around? Discover why some people are still hunting for them!
• Tech Nostalgia and Collecting: From TRS-80s to old SD cards, Dave reveals some hidden gems in his collection, including a brand new-in-box TRS-80 Model 1 Level 1 and why he was desperately hunting for vintage gear as a kid.
• Elon Musk, Tesla, and X (Twitter): We dive into the big questions around Elon Musk’s ventures, Tesla stock, and whether X (formerly Twitter) could be worth 10 times more in the near future.
• Navigating the Digital Age: As technology pushes more services online, what challenges do seniors and less tech-savvy folks face? Dave and Glen talk about their moms’ struggles and offer advice for managing in a rapidly changing world.
• Retirement, Travel, and Autism: Dave opens up about his life post-Microsoft, including his travels, the impact of autism on his routine, and the accommodations that help him navigate a world outside his comfort zone.
• Arcade Games and Coin Machines: Discover the fascinating mechanics behind payphones, arcade machines, and why a simple coin could make different sounds on a bell!
• Email Security and Services: From self-hosted solutions to Google and ProtonMail, Dave shares his insights on choosing the best email services for security and privacy.
• Future of Tech and Computing: What’s the next big thing in tech, and what are Dave and Glen most excited about? Hear their thoughts on where computing and tech will go from here.
Whether you’re a retro computing enthusiast, a tech hobbyist, or just curious about the latest tech trends and stories, this episode has something for everyone!
Sorry for the audio quality - I'm still learning the podcast software, and must have had some kind of noise cancelation on by default! We'll get better, I promise!
For my book on the spectrum, see: amzn.to/3XLJ8kY
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
We dive deep into the latest tech rumors, including the upcoming iPhone 16 specs, featuring enhanced AI neural cores, a new graphene thermal solution to tackle overheating, and improved camera technology. The duo also explores password manager security, discussing how tools like these can protect against phishing by verifying SSL certificates before autofilling.
Don’t miss the discussion on retro computing with Dave’s recent success in reviving a PDP-11/83, complete with functional floppies and network connectivity. Plus, the conversation touches on controversial topics like Facebook’s COVID-19 content moderation and the future of Windows security features.
Hit subscribe if you love tech insights, retro computing, and witty banter!
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Christies Auction: tinyurl.com/yc5mnnx4
Thanks to the Facebook PDP-11 group for the PDP-11 footage/images!
Sample items from the collection:
Apple-1 Personal Computer (1976) - Estimated at $500,000-800,000 
Xerox Alto (1973) - Estimated at $5,000-8,000 
DEC PDP-10 KI-10 Mainframe Computer (1974) - Estimated at $30,000-50,000 
MITS Altair 8800 Microcomputer (1976) - Estimated at $3,000-5,000 
CDC 6500 Supercomputer - Featured as one of the iconic supercomputers
Cray-2 Supercomputer - Another supercomputer milestone included in the collection
IBM 1401 Mainframe Computer - Part of a large IBM system included in the auction
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Discover Docker Hub: dockr.ly/3WY2a6W
Download Docker Desktop: dockr.ly/46HFL10
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Primes Language Racing: github.com/PlummersSoftwareLLC/Primes
Primeview Results Views: plummerssoftwarellc.github.io/PrimeView/?rc=50&rs=0&fr=&sc=dt&sd=True
Errata: At one point I say I'll be using an Ubuntu base image but the code actually uses Alpine, as you can see in the dockerfile on the screen. Sorry for any confusion this caused!
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Primes Project: github.com/PlummersSoftwareLLC/Primes
Sieve Code: github.com/davepl/MACRO-11/tree/main
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Pi3: amzn.to/3A2QG9e
Pi4: amzn.to/3YvFiNA
Pi5: amzn.to/4dp8Sby
Nano: amzn.to/4fqAA9D [No longer supported]
BBB: amzn.to/4d592oU
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Primes Language Racing: github.com/PlummersSoftwareLLC/Primes
Primeview Results Views: plummerssoftwarellc.github.io/PrimeView/?rc=50&rs=0&fr=&sc=dt&sd=True
For my book on the spectrum, see: amzn.to/3XLJ8kY
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Shirt is from GeeksOutfit.com
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
1. Introduction to the CrowdStrike Falcon IT Outage:
• Overview of the recent CrowdStrike Falcon IT outage and its impact on various industries.
2. Technical Details of the Outage:
• Explanation of the faulty sensor configuration update and how it led to system crashes (BSOD) on Windows systems.
• Specifics about the corrupted “Channel File 291.”
3. Impact and Response:
• Description of the scale of the outage, affecting approximately 8.5 million devices worldwide.
• Steps taken by CrowdStrike to deploy a fix and provide mitigation guidance to affected customers.
4. Previous Issues with Linux Systems:
• Recap of earlier incidents where CrowdStrike updates caused crashes on Debian and Rocky Linux systems.
5. CrowdStrike on macOS:
• Discussion about CrowdStrike’s security solutions for macOS and their use of Apple’s System Extensions.
6. Kernel vs. User Mode in Security Software:
• Analysis of why kernel-mode access is used by CrowdStrike and the associated risks.
• Historical context of kernel vs. user mode in Windows drivers.
7. Regulatory Challenges:
• Narrative on Microsoft’s attempt to introduce an API to prevent such issues and the regulatory hurdles faced from the European Union, which deemed it anticompetitive.
8. Conspiracy Theories and Broader Lessons:
• Overview of conspiracy theories that emerged around the outage.
• Lessons to be learned from the incident, drawing a parallel to the Tylenol crisis management.
I'm long since retired, and any opinions are mine alone; not a spokesperson!
Get the shirt: amzn.to/4bRUgAn
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Opinions are mine only, not a spokesperson!
I should add that I don't know if the channel definition update files were privately signed or not; what I meant is that I presume they do not go through the WHQL signing process. But even if they do, we've learned that trusting their content (which was all zeros in this case) didn't go well.
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
So they wound up doing exactly what I was trying to avoid (a bitmap per SKU per language) but it works!
---
How does the Start Menu paint? Find out in this insider tale of the Windows Start Menu. For my book on the spectrum, see: amzn.to/3XLJ8kY
As noted in the video, the Start Menu was a Windows95 feature before being ported to what is "Windows" today; Dave was responsible for making it operate and paint under Windows NT/XP/2000 and later.
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Siekon Batteries: amzn.to/3WgmRe4. [Coupon code SIEKON11]
Short Extension Cables: amzn.to/3zxA5dv
Ethernet extender: amzn.to/3XTygSb
Serial extender: amzn.to/4bKA9Ek
2000W inverter: amzn.to/3XRULqM
60-foot USB cable: amzn.to/3XZcDjs
Unibone: retrocmp.com/projects/unibone
For information on the Unibone (and QBone), visit HTTP://RetroCMP.com
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
Follow me for updates!
Twitter: @davepl1968 davepl1968
Facebook: fb.com/davepl
For information on the Unibone (and QBone), visit HTTP://RetroCMP.com
Follow me for updates!
Twitter: @davepl1968davepl1968
Facebook: fb.com/davepl
Note: Contains flashing light elements.
Code: github.com/PlummersSoftwareLLC/FanFreezer
NOTE: Contains flashing lights and effects.
NightDriverLED code project: github.com/PlummersSoftwareLLC/NightDriverStrip
Visit JLCPCB: http://www.jlcpcb.com. http://www.easyeda.com
$2 for 1-8 Layer PCB, get JLCPCB $54 coupons jlcpcb.com/RHS
Cheap LED Strip for experiments: amzn.to/3yWNECQ
A good ESP32 Module to start with: amzn.to/3xfaLrP
Spitz AX 5G WiFi 6: amzn.to/3x7GcUV
GL-iNet Basic Travel Router: amzn.to/4bQM2sG
Heltec Wifi Kit 32 v3: amzn.to/3XgSNA7
Enforcer Sensor: amzn.to/3WZNAfQ
Main code on Github: github.com/davepl/IndigoAction/blob/main/src/main.cpp
Video Credit: youtube.com/watch?v=S6OjDU44bMo
LUBA 2 by Mammotion: us.mammotion.com
Some sequences shortened or accelerated.
Book and Sample: amzn.to/3K79TZh


