Offline AI on iOS and Android @SirajRaval
Offline AI on iOS and Android  @SirajRaval
Uploaded September 2023 | Updated September 2026, 2 weeks ago
I compiled a PyTorch AI model to run locally on iOS & Android! This keeps conversations private, free, & data compliant (both GDPR & HIPAA). In this video tutorial, i'll show you exactly how I did this for my ongoing healthcare project titled Doctor Dignity (previously titled DoctorGPT) so that you can do the same thing for any AI model, particularly Large Language Models. We start by building a simple language model in Python that runs on an Intel CPU, then accelerate it using CUDA for Nvidia GPUs, Metal for iOS GPUs, Vulkan for Android GPUs, and finally the Tensor Virtual Machine for both iOS and Android. We have a lot to GPU Programming cover in this video, comparing and contrasting different GPU programming techniques (computation vs allocation, abstraction vs transformation, stochastic optimization vs gradient based optimization). My next goal is to get a 3 billion parameter model to pass the US Medical Licensing exam and run on mobile devices. Don't worry if you're a beginner to all this, just sit back relax and enjoy the ride, I tried to make this as accessible as possible to all developers.

Star Doctor Dignity on GitHub:
github.com/llSourcell/Doctor-Dignity

Please Subscribe! That's what keeps me going.

Want more AI/ML education? Connect with me here:
X: https://x.com/sirajraval
Instagram: instagram.com/sirajraval
Facebook: facebook.com/sirajology
Linkedin: linkedin.com/in/sirajraval
Tiktok: tiktok.com/@sirajraval

Doctor Dignity Original Video:
youtu.be/J9nJh33GM-w

Doctor Dignity iOS app: (Warning: this is a beta with bugs, please do not have high expectations, i promise it will get a lot better next month)
apps.apple.com/us/app/doctor-dignity/id6464528573

I Built a Trading bot with Bing and ChatGPT:
youtu.be/5G1_zRME_pY

I Built a Sports Betting Bot with ChatGPT:
youtube.com/watch?v=IDthta5sUGQ

I Built a Trading Bot with ChatGPT:
youtube.com/watch?v=fhBw3j_O9LE

Watch ChatGPT Build an AI Startup:
youtube.com/watch?v=hL2hLFUwuqQ

Watch ChatGPT Build a Finance Startup:
youtube.com/watch?v=on623d5EfPw

Learn Machine Learning in 3 Months:
youtube.com/watch?v=dS2HYPY7T-4

Join my AI community:
http://gptschool.app Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available): https://www.wagergpt.xyz
Offline AI on iOS and AndroidI Gave a Terminal Agent My Whole Codebase. Then I Walked Away.I Quit Chrome for an AI Browser. It Actually Worked.Sports Betting with OddsGPTQuantum SupremacyLearn Machine Learning in 3 Months (PyTorch Curriculum)AI in 2020This Shipping Container Powers 20,000 AI ChipsI Built a Trading Bot with Cursor (Beginner Tutorial)3 Limits of Artificial IntelligenceHow to Build a Retail StartupConvolutional Networks for Heart Disease Prediction (AlphaCare: Episode 1)
Siraj Raval |

Offline AI on iOS and Android

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER