Ctrl Menu
Web Portal
10:33 May 15, 2021
Home Lab Build - P.2 - Rack has evolved!
Web Portal
_ Minimize
Full View
Guide View
Open
Back
Forward
Go
|<
>
O
>|
10:33 / 11:11
Home Lab Build - P.2 - Rack has evolved! @sentdex
updated 4 years ago
Home Lab Build - P.2 - Rack has evolved!
sentdex 2022-07-01 | Quite a few changes to the server rack, starting with a patch panel and another ethernet switch. From here, I've mounted a KVM switch, mouse, keyboard, and monitor. Part 1: youtu.be/CIQ20FWs478 Hardware purchase links: Patch Panel: amzn.to/3nrAODB KVM switch: amzn.to/3bFuTbE KVM switch VGA & USB cables: amzn.to/3yxXXuo Boxx rack mount machines: boxx.com 1U drawer: amzn.to/3ycRP9U 2U drawer: amzn.to/3y6BXWf Rack monitor mount: amzn.to/3y9uu8M Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex Contents: 0:00 - Networking 1:23 - KVM Switch (TRENDnet 2-in-1 USB VGA KVM) 3:11 - rack mounting the Boxx machine 5:49 - Rack mounting a monitor 8:24 - Server rack flooring :) 8:55 - Blanking panel, 2U drawer, outro #server #homelab
Building an LLM fine-tuning Dataset
sentdex 2024-03-06 | Going through the building of a QLoRA fine-tuning dataset for a language model. NVIDIA GTC signup: nvda.ws/3XTqlB6 Fine-tuning code: github.com/Sentdex/LLM-Finetuning 5000-step Walls1337bot adapter: huggingface.co/Sentdex/Walls1337bot-Llama2-7B-003.005.5000 WSB Dataset: huggingface.co/datasets/Sentdex/WSB-003.005 "I have every reddit comment" original reddit post and torrent info: reddit.com/r/datasets/comments/3bxlg7/i_have_every_publicly_available_reddit_comment 2007-2015 Reddit Archive.org: archive.org/download/2015_reddit_comments_corpus/reddit_data Reddit BigQuery 2007-2019 (this has other data besides reddit comments too!): reddit.com/r/bigquery/comments/3cej2b/17_billion_reddit_comments_loaded_on_bigquery Contents: 0:00 - Introduction to Dataset building for fine-tuning. 02:53 - The Reddit dataset options (Torrent, Archive.org , BigQuery) 06:07 - Exporting BigQuery Reddit (and some other data) 14:44 - Decompressing all of the gzip archives 25:13 - Re-combining the archives for target subreddits 28:29 - How to structure the data 40:40 - Building training samples and saving to database 48:49 - Creating customized training json files 54:11 - QLoRA training and results Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Visualizing Neural Network Internals
sentdex 2024-02-14 | Visualizing some of the internals of a neural network during training and inference. Starting and full code: github.com/Sentdex/neural-net-internals-visualized Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
sentdex 2024-02-07 | Establishing an internet connection in an internet desert, then figuring out (well, starting to) networking. Combined with Starlink as my internet provider, I ended up going with a wifi bridge implementation with a couple of Ubiquiti nanostation AC locos to network between buildings at 100+ meters of distance. The Ubiquiti units can also do point to point (ptp), but so far the wifi bridge setup is working great for me. Ubiquiti NanoStation 5AC Locos (buy in pairs for ptp/wifi bridge): amzn.to/3UqnLnQ Mounting hardware I used, but you can use just about anything, including zip tying to a tree or something: amzn.to/42ycS5d PoE Injectors (can use any PoE switch too): amzn.to/482oNJO Silicone sealant: amzn.to/42vu5w9 For shorter distances, you can also use: TPLink Access Points (AP): amzn.to/3OCe6qp I also have enjoyed the 2016 model years of the Google wifi: amzn.to/495Ydkm These are half the price of the newer version, the nest variant: amzn.to/3HSDdBM If I forgot something, feel free to ask! Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Open Source AI Inference API w/ Together
sentdex 2023-12-24 | Exploring the Together Inference API (together.ai ) Together API basics jupyter notebook examples: github.com/Sentdex/Together-API-Basics Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
INFINITE Inference Power for AI
sentdex 2023-12-16 | Testing and enjoying the Comino Grando Server machine with 6x RTX 4090s from Comino (comino.com ) Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Pandas Dataframes on your GPU w/ CuDF
sentdex 2023-11-10 | An overview and some quick examples of using CuDF's Pandas accelerator and how much faster it can be than vanilla Pandas for data analysis. Colab demo of Rapids: nvda.ws/3LWggQj AI and Data Science Virtual Summit: nvda.ws/3ZR3wjL Notebook in this video: gist.github.com/Sentdex/469c30385d06719519af13125db85edc Install CuDF: pip install cudf-cu11 --extra-index-url=pypi.nvidia.com (or cu12) Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
QLoRA is all you need (Fast and lightweight model fine-tuning)
sentdex 2023-09-15 | Learning and sharing my process with QLoRA (quantized low rank adapters) fine-tuning. In this case, I use a custom-made reddit dataset, but you can use anything you want. I referenced a LOT of stuff in this video, I will do my best to link everything, but let me know if I forget anything. Resources: WSB-GPT-7B Model: huggingface.co/Sentdex/WSB-GPT-7B WSB-GPT-13B Model: huggingface.co/Sentdex/WSB-GPT-13B WSB Training data: huggingface.co/datasets/Sentdex/wsb_reddit_v002 Code: QLoRA Repo: github.com/artidoro/qlora qlora.py: github.com/artidoro/qlora/blob/main/qlora.py Simple qlora training notebook: colab.research.google.com/drive/1VoYNfYDKcKRQRor98Zbf2-9VQTtGJ24k?usp=sharing qlora merging/dequantizing code: gist.github.com/ChrisHayduk/1a53463331f52dca205e55982baf9930 Referenced Research Papers: Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning: arxiv.org/abs/2012.13255 LoRA: Low-Rank Adaptation of Large Language Models: arxiv.org/abs/2106.09685 QLoRA: Efficient Finetuning of Quantized LLMs: arxiv.org/abs/2305.14314 Yannic's GPT-4chan model: huggingface.co/ykilcher/gpt-4chan Condemnation letter: docs.google.com/forms/d/e/1FAIpQLSdh3Pgh0sGrYtRihBu-GPN7FSQoODBLvF7dVAFLZk2iuMgoLw/viewform youtube.com/watch?v=efPrtcLdcdM Contents: 0:00 - Why QLoRA? 0:55 - LoRA/QLoRA Research 4:13 - Fine-tuning dataset 11:10 - QLoRA Training Process 15:02 - QLoRA Adapters 17:10 - Merging, Dequantizing, and Sharing 19:34 - WSB QLoRA fine-tuned model examples Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Chat Interface for your Local Llama LLMs
sentdex 2023-08-22 | A tutorial of sorts covering how to create streaming chat interfaces using Gradio for the various chat/instruct large language models from HuggingFace. Sample code: huggingface.co/spaces/Sentdex/StableBeluga-7B-Chat/blob/main/app.py Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Gzip is all You Need! (This SHOULD NOT work)
sentdex 2023-07-28 | Github code: github.com/Sentdex/Simple-kNN-Gzip Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Better Attention is All You Need
sentdex 2023-07-11 | Addressing the current state of attention for artificial intelligence and why it's currently holding back maximum context lengths. Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
The BEST Open Source LLM? (Falcon 40B)
sentdex 2023-07-05 | TII Call for Proposals with Falcon 40B: https://falconllm.tii.ae/proposal.php Falcon Github samples: github.com/Sentdex/Falcon-LLM TermGPT: youtube.com/watch?v=O4EmRi0_CI4 GPT-4 Overview: youtube.com/watch?v=lJNblY3Madg Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
OpenAI GPT-4 Function Calling: Unlimited Potential
sentdex 2023-06-15 | Function calling is a new capability for OpenAI's GPT-4 and GPT-3.5 via the API. Function-calling allows you to extract structured outputs from the GPT model. Github notebook: github.com/Sentdex/ChatGPT-API-Basics/blob/main/function_calling.ipynb Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Letting GPT-4 Control My Terminal (TermGPT)
sentdex 2023-06-03 | Giving LLMs like GPT-4 the ability to plan and execute terminal commands. TermGPT github: github.com/Sentdex/TermGPT OpenAI Chat API tutorial: github.com/Sentdex/ChatGPT-API-Basics Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Building an Open Assistant API
sentdex 2023-05-12 | Working with one of the Open Assistant models, a 12B parameter Pythia model (huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5 ) Github: github.com/Sentdex/OpenAssistant_API_Pythia_12B Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex Video Contents: 00:00 - Basics of using OpenAssistant Pythia 12B locally 16:37 - Creating an OpenAssistant API 22:22 - Interfacing with our new OpenAssistant API 31:32 - Handling for long contexts
Sparks of AGI? - Analyzing GPT-4 and the latest GPT/LLM Models
sentdex 2023-04-28 | An in-depth look into the current state of the art of Generative Pre-trained Transformer (GPT) language models, with a specific focus on the advancements and examples provided by OpenAI in their GPT4 Technical Report (arxiv.org/abs/2303.08774 ) as well as the Microsoft "Sparks of AGI" Paper (arxiv.org/abs/2303.12712). Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex Contents: 00:00 - Introduction 01:31 - Multi-Modal/imagery input 05:44 - Predictable scaling 08:15 - Performance on exams 15:07 - Rule-Based Reward Models (RBRMs) 17:53 - Spatial Awareness of non-vision GPT-4 20:38 - Non-multimodel vision ability 21:27 - Programming 25:07 - Theory of Mind 29:34 - Music and Math 30:44 - Challenges w/ Planning 33:25 - Hallucinations 35:04 - Risks 38:01 - Biases 44:55 - Privacy 48:23 - Generative Models used in Training/Evals 51:36 - Acceleration 57:07 - AGI
ChatGLM: The ChatGPT killer? Checking out ChatGLM6B
sentdex 2023-04-08 | Exploring the concept of a GLM (General Language Model) and working with ChatGLM6B. Original GLM paper: arxiv.org/abs/2103.10360 GLM130B paper: arxiv.org/abs/2210.02414 ChatGLM6B demo: huggingface.co/spaces/multimodalart/ChatGLM-6B Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
GPT Journey - A text and image game with ChatGPT
sentdex 2023-03-24 | Building a text and image-based game with ChatGPT as the backend via the api... plus a little help from ChatGPT to build it. Github: github.com/Sentdex/GPT-Journey Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
sentdex 2023-03-10 | Exploring the ChatGPT (GPT3.5) API from OpenAI and building some simple chat applications with it. Github code: github.com/Sentdex/ChatGPT-API-Basics Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex Contents: 0:00 - Why use the ChatGPT API 2:10 - How to query the ChatGPT API 7:45 - History and dynamic input w/ ChatGPT API 15:30 - Comining everything so far 18:25 - Building a Gradio chat application with ChatGPT
sentdex 2023-03-03 | Checking out some of the latest A.I. Photo and Video editing software available on HuggingFace. NVIDIA GTC Signup (Digital event March 20-23): nvda.ws/3XTqlB6 Neural Networks from Scratch book: nnfs.io ControlNet (doodle to image, edge detection, pose...etc): huggingface.co/spaces/hysts/ControlNet Instruct Pix2Pix: huggingface.co/spaces/timbrooks/instruct-pix2pix Pix2Pix video: huggingface.co/spaces/fffiloni/Pix2Pix-Video Photoguard: huggingface.co/spaces/RamAnanth1/photoguard Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
The AI wars: Google vs Bing (ChatGPT)
sentdex 2023-02-11 | Discussing the latest events surrounding large language models, chatbots, and search engines with respect to Microsoft and Google. Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
ChatGPT Writes a Chatbot AI
sentdex 2023-01-25 | Creating a large language model (LLM)-backed chat bot application entirely with ChatGPT. Github repo for the end result: github.com/Sentdex/ChatGPT-at-Home Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
OpenAIs ChatGPT is a MASSIVE step forward in Generative AI
sentdex 2022-12-10 | ChatGPT is the latest GPT style generative AI model from OpenAI, which, at it's most basic level acts as a chatbot, but this back and forth structure allows for many complex capabilities. Chat with ChatGPT here: chat.openai.com/chat Operating system example with the script writing to a file: twitter.com/Sentdex/status/1600609223548739585?t=3KJw_yb6hPjDNbQoI27ScA&s=19 Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
OpenAIs ChatGPT creates an operating system
sentdex 2022-12-07 | OpenAI's ChatGPT AI (a neural network) functioning as a Linux system that I am able to navigate, read, write and execute scripts on. Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Google A.I. Diffusion Image Editing w/ Prompt to Prompt
sentdex 2022-11-13 | Prompt to prompt allows you to make natural language edits to your prompt to edit the image. Prompt-to-prompt github: github.com/google/prompt-to-prompt Prompt-to-prompt w/ stable diffusion notebook: github.com/google/prompt-to-prompt/blob/main/prompt-to-prompt_stable.ipynb Stable DreamFusion video: youtube.com/watch?v=zWD5ZR5GtJM GAN Theft Auto: youtube.com/watch?v=udPY5rQVoW0 Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Googles DreamFusion AI: Text to 3D
sentdex 2022-10-21 | DreamFusion is Google research (arxiv.org/pdf/2209.14988.pdf ) into generating 3D objects from text prompts, and is based off 2D diffusion models. Stable DreamFusion github: github.com/ashawkey/stable-dreamfusion?s=03 NeRF (Neural Radiance Fields): matthewtancik.com/nerf Meta AI make-a-video: https://makeavideo.studio/ Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Open AI’s Whisper is Amazing!
sentdex 2022-10-06 | OpenAI's Whisper is a speech to text, or automatic speech recognition model. It is a "weakly supervised" encoder-decoder transformer trained on 680,000 hours of audio. Not only can it transcribe English, it can transcribe 96 other languages along with also being able to translate from those languages to English. Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
The Future of User Interfaces with A.I.
sentdex 2022-09-29 | Pondering the future of user interfaces with advancements in natural language processing and artificial intelligence Tweet in reference: twitter.com/c_valenzuelab/status/1574448455463862274 Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
sentdex 2022-09-26 | Artificial intelligence teaches you how to incorporate your deep learning models into user interfaces for humans, using Gradio. Created using #copilot for the code, Riva (developer.nvidia.com/riva ) from NVIDIA for custom speech synthesis, and a handful of LLMs for scripting. Things are getting interesting. Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex #programming #shorts #pythonprogramming
Customizing Stable Diffusion w/ Text Inversion #shorts #programming
sentdex 2022-09-23 | Using Stable Diffusion, a text to image generation AI model, to generate more personalized imagery through text inversion. Original Text Inversion Paper: arxiv.org/pdf/2208.01618.pdf Text Inversion HuggingFace: huggingface.co/docs/diffusers/training/text_inversion Text Inversion Notebook for training/testing: colab.research.google.com/github/huggingface/notebooks/blob/main/diffusers/sd_textual_inversion_training.ipynb Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex #shorts #programming #education
Creating Stable Diffusion Interpolation Videos
sentdex 2022-09-16 | GTC signup: nvda.ws/3BQvmCP Stable Diffusion Videos Github: github.com/nateraw/stable-diffusion-videos Gist for hunting for images: gist.github.com/Sentdex/130c225d90acec7c808b8ba5aba0eda1 Gist for creating stable diffusion video: gist.github.com/Sentdex/f9519adf3b0ac79370d2c0e31b00593b Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Exploring an AI’s Imagination (Stable Diffusion and MidJourney)
sentdex 2022-09-03 | Exploring a couple of the latest text to image generators that you can begin using right now, Stable Diffusion and MidJourney. Stable Diffusion model download: huggingface.co/CompVis/stable-diffusion-v1-4 MidJourney website: midjourney.com/home BLOOM AI model video: youtube.com/watch?v=3EjtHs_lXnk DreamStudio: beta.dreamstudio.ai Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
sentdex 2022-08-12 | Imagine an AI where, all in the same model you could Translate languages, Write code, solve crossword puzzles, Be a chatbot and do a whole bunch of other crazy things. In this video, we check out the BLOOM large language model. A free and totally open source 176B parameter LLM. BLOOM model: huggingface.co/bigscience/bloom Quick examples of running BLOOM locally and/or via API: github.com/Sentdex/BLOOM_Examples Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex Contents: 0:00 - BLOOM model basics 3:05 - What's a Large Language Model (LLM)? 4:06 - What's Prompting? 6:40 - BLOOM Training Data & Model Behavior 9:09 - Tokens & Tokenization 12:03 - Using your $5M AI (How to prompt) 16:49 - Advanced Prompt examples 21:16 - What's Next? #deeplearning #artificialintelligence
Does a Deep Learning Laptop Exist? - Tensorbook Review
sentdex 2022-07-19 | Reviewing Lambda and Razer's Tensorbook, a laptop aimed at deep learning, with 16GB of VRAM (GPU memory), 64GB of RAM, 2TB of NVMe storage and an 8-core intel i7 11800H CPU.lambdalabs.com/deep-learning/laptops/tensorbook Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Home Lab Build - P.1 - Building a NAS
sentdex 2022-06-15 | My home lab journey. Part 2: youtu.be/BVWmstt0AWM Server rack: StarTech.com 42U 19" Open Frame Server Rack - 4 Post Adjustable Depth 22-40" amzn.to/3NSeQ8B Rails: 1U 19 inch Server Rack Rails: amzn.to/3OhHHD9 Switch: 10G 8 Port TP-Link switch: amzn.to/3NTRRKn NAS Build: Case: Rosewill 4U 12-bay hot swap server rack casing: amzn.to/3xks2fm Motherboard: GIGABYTE Z590 AORUS Master: amzn.to/3tzCHlj CPU: Intel® Core™ i5-11600K: amzn.to/3Of9W5f RAM: Corsair Vengeance LPX 32GB: amzn.to/3NUJM80 Power Supply: Corsair RM850x: amzn.to/3xLYqJh 4x 18TB: Seagate Exos X18 18TB Enterprise HDD: amzn.to/3MKwM3H 3x 120mm Noctua fans: amzn.to/3QlXi6j 2x 80mm Noctua fans: amzn.to/3xOFb1w Super quiet Puget Workstation build: hubs.ly/H0-By8Q0 PCIe SATA Expansion: amzn.to/3Odm9Yi TrueNAS Core 12.0 install tutorial video I used: youtube.com/watch?v=nVRWpV2xyds Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex Contents: 00:00 - Server rack types 00:30 - StarTech 42U 4 Post Open Frame Server Rack 01:15 - Network Area Storage (NAS) 02:42 - Prebuilt NAS Options (QNAP vs Synology) 03:36 - Custom-built rack-mount NAS 07:52 - Server rack Power Distribution Unit (PDU) (Tripplite PDU1230) 09:48 - Server Rack/Homelab networking (TP-Link TL-SX1008) 8x 10G 11:35 - StarTech 1U 19" Server Rack Rails 12:21 - TrueNAS 13 w/ RAIDZ1 14:03 - Why HomeLab? #homelab #server
Python Plays GTA V: Reboot - Announcement
sentdex 2022-05-03 | Live self-driving car model training: twitch.tv/sentdex Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
A. I. Learns to Play Starcraft 2 (Reinforcement Learning)
sentdex 2022-04-23 | Tinkering with reinforcement learning via Stable Baselines 3 and Starcraft 2. Code and model: github.com/Sentdex/SC2RL Stable Baselines 3 tutorial: pythonprogramming.net/introduction-reinforcement-learning-stable-baselines-3-tutorial Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex #artificialintelligence #machinelearning #python
Better tracking for your deep learning training - Wandb.ai (Weights & Biases)
sentdex 2022-03-23 | Introduction and overview of Weights and Biases: wandb.ai text-based writeup: pythonprogramming.net/wandb-deep-learning-tracking Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Why & how two or more hidden layers w/ nonlinear activation function works deep learning (MVP 0051)
sentdex 2022-03-21 | More information: nnfs.io/mvp Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
WHERE NNFS?! Signed 3090 & Upcoming Content
sentdex 2022-03-09 | GTC Signup: nvda.ws/3oi1vfE To be eligible, you just need to signup to GTC via my link and attend one of the sessions between March 21st and 24th. Good luck! Neural Networks from Scratch book: nnfs.io Video contents: 0:00 - RTX 3090 Signed GPU 1:20 - Where are the NNFS videos 4:24 - RL, Quadrupeds, Comino Project 4:54 - NNFS book 6:51 - RL w/ Quadrupeds and Starcraft 2 + Comino 7:45 - NeoX 20B parms 9:14 - J1 Jumbo (178B parms) Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Attacking and Defeating the Enemy - Starcraft 2 AI with Python (p.3)
sentdex 2022-03-07 | Welcome to part 3 of the Starcraft AI with Python series. In the previous tutorials we learned the basics of writing an AI agent within Starcraft 2, but we've not yet been able to defeat the enemy computer player. In order to do this, we're going to need to go on the offensive. There are many different types of units that we can go with to play more offensively, but my unit of choice is going to be the Void Ray. This is a good general purpose unit that flies around and shoots a laser beam. Text-based tutorial: pythonprogramming.net/attacking-python-sc2-introduction-starcraft-2-ai Asyncio basics: pythonprogramming.net/asyncio-basics-intermediate-python-tutorial Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Starcraft 2 AI with Python - Building Defenses (p.2)
sentdex 2022-03-06 | Adding logic to the Starcraft 2 artificial intelligence to defend our main base. Text-based tutorial: pythonprogramming.net/defending-python-sc2-introduction-starcraft-2-ai Asyncio basics: pythonprogramming.net/asyncio-basics-intermediate-python-tutorial Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Starcraft 2 AI with Python - Introduction (p.1)
sentdex 2022-03-05 | Welcome to a tutorial for building artificial intelligence agents within Blizzard's Starcraft 2 game. I visited this topic some years ago, but quite a bit has changed, so I figured I would revisit it again. For those of you who are new to Starcraft 2 (SC2) or it's been a while, the game at a basic level is actually fairly easy to understand. In order to be highly competitive, lots of factors can indeed come into play, but if you're looking for a fun environment to try your programming and maybe even deep learning/reinforcement learning skills, this is a pretty good choice. Text-based tutorial: pythonprogramming.net/intro-python-sc2-introduction-starcraft-2-ai Asyncio basics: pythonprogramming.net/asyncio-basics-intermediate-python-tutorial Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
The COOLEST Deep Learning Machine - The Comino Grando RM V2 Short
sentdex 2022-02-11 | Checking out a fully custom water-cooled build with 4 A100 40GB cards. An insane powerhouse in a tiny form factor. Comino Website: grando.ai/choose-a-gpu-machine-for-ai-deep-learning/?utm_source=youtube&utm_medium=video&utm_campaign=sentdex#grando-rm Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex #comino #watercooling #deeplearning
Tweaking Custom Environment Rewards - Reinforcement Learning with Stable Baselines 3 (P.4)
sentdex 2022-02-08 | Helping our reinforcement learning algorithm to learn better by tweaking the environment rewards. Text-based tutorial and sample code: pythonprogramming.net/engineering-rewards-reinforcement-learning-stable-baselines-3-tutorial Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Custom Environments - Reinforcement Learning with Stable Baselines 3 (P.3)
sentdex 2022-02-07 | How to incorporate custom environments with stable baselines 3 Text-based tutorial and sample code: pythonprogramming.net/custom-environment-reinforcement-learning-stable-baselines-3-tutorial The snake game we use here is just randomly taken from an internet search for one, this is what I used: github.com/TheAILearner/Snake-Game-using-OpenCV-Python/blob/master/snake_game_using_opencv.ipynb Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Saving and Loading Models - Stable Baselines 3 Tutorial (P.2)
sentdex 2022-02-06 | How to save and load models in Stable Baselines 3 Text-based tutorial and sample code: pythonprogramming.net/saving-and-loading-reinforcement-learning-stable-baselines-3-tutorial Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Reinforcement Learning with Stable Baselines 3 - Introduction (P.1)
sentdex 2022-02-05 | Welcome to a tutorial series covering how to do reinforcement learning with the Stable Baselines 3 (SB3) package. The objective of the SB3 library is to be for reinforcement learning like what sklearn is for general machine learning. Text-based tutorial and sample code: pythonprogramming.net/introduction-reinforcement-learning-stable-baselines-3-tutorial Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
Robot Dog Learns to Walk - Bittle Reinforcement Learning p.3
sentdex 2022-01-01 | Further progress with using reinforcement learning to train robot dogs/quadrupeds to walk Neural Networks from Scratch book: nnfs.io autoencoders tutorial: pythonprogramming.net/autoencoders-tutorial The actual Petoi Bittle robot can be found here: petoi.com/collections/robots/products/petoi-bittle-robot-dog?variant=40388667834552&utm_source=sendex&utm_campaign=bittle&utm_content=simulator3 #reinforcementlearning #python #robotics Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex
A new addition to the fleet - Puget Workstation overview
sentdex 2021-12-06 | General overview and review of my latest PC build from Puget (hubs.ly/H0-By8Q0 ) Bittle robot dogs and reinforcement learning series: youtube.com/playlist?list=PLQVvvaa0QuDenVbxP4LXYZoGbjfgP-Y5i Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex Support the content: pythonprogramming.net/support-donate Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net Twitch: twitch.tv/sentdex