Your NVIDIA GPU can power a free ChatGPT (Chat with RTX) @mrdbourke
Your NVIDIA GPU can power a free ChatGPT (Chat with RTX)  @mrdbourke
Uploaded March 2024 | Updated November 2026, 4 days ago
Chat with RTX is a ChatGPT-style application that uses Retrieval Augmented Generation (RAG) to allow you to chat with your own data on your own local NVIDIA GPU/PC.

Links mentioned:
Download Chat with RTX - nvidia.com/en-au/ai-on-rtx/chat-with-rtx-generative-ai
NVIDIA RAG blog post - developer.nvidia.com/blog/rag-101-demystifying-retrieval-augmented-generation-pipelines
My RAG tutorial (code from scratch) - youtu.be/qN_2fnOPY-M

Sign up to NVIDIA GTC 2024 - nvda.ws/3GUZygQ

PDF links:
Attention is all you need paper - arxiv.org/abs/1706.03762
Embeddings paper - vickiboykis.com/what_are_embeddings
Math for ML book - mml-book.github.io/book/mml-book.pdf
Charlie Walks (my novel) - charliewalks.com
Nutrition Textbook - https://pressbooks.oer.hawaii.edu/humannutrition2/

Other links:
Download Nutrify (my startup) - https://nutrify.app
Learn AI/ML (beginner-friendly course) - dbourke.link/ZTMMLcourse
Learn TensorFlow - dbourke.link/ZTMTFcourse
Learn PyTorch - dbourke.link/ZTMPyTorch
AI/ML courses/books I recommend - mrdbourke.com/ml-resources
Read my novel Charlie Walks - charliewalks.com

Connect elsewhere:
Web - dbourke.link/web
X/Twitter - twitter.com/mrdbourke
Twitch - twitch.tv/mrdbourke
ArXiv channel (past streams) - dbourke.link/archive-channel
Get email updates on my work - dbourke.link/newsletter

Timestamps:
0:00 - Intro
0:17 - Chat with RTX requirements
054 - What is Chat with RTX?
1:51 - Downloading Chat with RTX
2:06 - Installing Chat with RTX
2:09 - Make sure to upgrade your NVIDIA Graphics Driver
2:41 - Chat with RTX setup steps
3:04 - What are INT4 models?
3:25 - Opening Chat with RTX
3:48 - Chat with RTX running in the browser
4:33 - Allowing Chat with RTX to work with your own custom data
5:11 - Turning your own custom data into embeddings
6:43 - Question 1: What are embeddings?
7:18 - Question 2: What is the attention mechanism?
7:51 - Question 3: What is matrix multiplication?
8:31 - Question 4: What is Charlie's secret project? (asking a novel)
9:06 - Question 5: What are the macronutrients? And their functions?
10:07 - Outro/NVIDIA GTC

#AI #NVIDIA #GTC24
Your NVIDIA GPU can power a free ChatGPT (Chat with RTX)I didnt eat food for 5 days, heres what happenedTensorFlow for Deep Learning course Udemy launch Q&A (live)Ask a Machine Learning Engineer Anything (live) | April 2020Advice for junior engineers: start the job before you have itI got my machine learning model deployed! | Airbnb Amenity Detection Part 8These 5 ZUU movements burn fat and train your whole bodyOne Neural Network to Rule Them All (and more) | Machine Learning Monthly June 2020Learn TensorFlow and Deep Learning fundamentals with Python (code-first introduction) Part 1/2Self-taught Machine Learning Engineer AMA (live)Benchmarking: NVIDIA DGX Spark & NVIDIA RTX 4090 | Part 3 - Running LLMs on the RTX 4090What does it take to build a Realistic RAG in 2025? | AI & ML Monthly
Daniel Bourke |

Your NVIDIA GPU can power a free ChatGPT (Chat with RTX)

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER