How To Create A NVIDIA H100 GPU Cloud Server To Run And Train AI, ML, And LLMs Apps On DigitalOcean @Websplaining
How To Create A NVIDIA H100 GPU Cloud Server To Run And Train AI, ML, And LLMs Apps On DigitalOcean  @Websplaining
Uploaded October 2024 | Updated November 2026, 4 days ago
In this video, you will learn how to setup a NVIDIA H100 Graphics Processing Unit (GPU) Virtual Private Server (VPS) also known as a cloud server to run and train Artificial Intelligence (AI), Machine Learning (ML), and Large Language Models (LLMs) applications on DigitalOceans GPU droplet service. DigitalOcean GPU droplets come configured with all the necessary NVIDIA drivers and software preinstalled to help you get started on your AI/ML journey. DigitalOceans GPU droplets AI/ML ready images, come preinstalled with the Ubuntu Linux Operating System (OS).

I may earn a commission if you use the link below to sign up, at no extra cost to you.
🔵Free $200 DigitalOcean cloud credits using my affiliate link: websplaining.com/digitalocean

Steps To Setup GPU Droplets On DigitalOcean:
1. Go to websplaining.com/digitalocean and create a free DigitalOcean account. The above link is my referral link granting you $200 in free cloud credit for 60 days as a new user
2. Once you have created your DigitalOcean account, you will be taken to your DigitalOcean project dashboard. Click Create.
3. Click GPU Droplets
4. Configure your droplet to your liking ensuring to select DigitalOceans AI/ML Ready image
5. Add a Public SSH Key for authentication, and for logging into your GPU droplet via SSH. You will need to download and install PuTTY you can do so here putty.org or follow this step by step video of mine youtu.be/0ptZPTTwRa
6. Once you got PuTTY and all its complementary software, open PuTTYgen (PuTTY Key Generator)
7. Click Generate and move your mouse randomly to generate your public and private key pair
8. Copy and paste your public key into DigitalOcean, click add SSH Key and and select your added public key for use with the droplet you're creating
9. In PuTTYgen save your Private key on your local machine and also save your Public key as a backup
10. Go back to your DigitalOcean and click Create GPU Droplet
11. Once your GPU droplet is active, copy the IPV4 address of your GPU droplet in the Overview tab under connection details and open up the PuTTY program
12. Paste in your GPU droplets IP address into the hostname section of PuTTY
13. Click the + symbol next to the SSH category in PuTTY
14. Click Auth
15. Click Browse and find your Private SSH key that you generated using PuTTYgen and saved on your local device.
16. Click Open to select it and then click Open again on PuTTY
17. The PuTTY command line terminal will then open and you should see Login as at the top left of the terminal
18. Type root and press Enter on your keyboard
19. You have now logged into your GPU droplet and can now begin training and running your AI/ML/LLM apps through the terminal.

Commands to check NVIDIA GPU Specs (in order from least information to most):
nvidia-smi -L
nvidia-smi
nvidia-smi -q

Congratulations, you have successfully created a NVIDIA GPU droplet that's AI/ML ready!

DigitalOcean NVIDIA H100 Droplet Specs (Single GPU):
- 1 GPU
- 80 GB VRAM
- 20 vCPU
- 240 GB RAM
- Boot disk: 720 GB NVMe
- Scratch disk: 5 TB NVMe

DigitalOceans AI/ML-ready image is Ubuntu 22.04 based and includes at the time of recording of this video:

- nvidia-container-toolkit=1.16.2-1
- cuda-keyring_1.1-1
- cuda-drivers-535
- cuda-toolkit-12-1
- bzip2 (8 GPU Droplets only)
- MLNX_OFED_LINUX-23.10-1.1.9.0-ubuntu22.04-x86_64 (8 GPU Droplets only)
- nvidia-fabricmanager-535 (8 GPU Droplets only)

Timestamps:
0:00 - Intro & Context
0:29 - Create DigitalOcean GPU Droplet (Cloud Server)
2:25 - Generate SSH Private And Public Key Pair For Authentication
6:56 - Log Into Your GPU Droplet Using Your Private Key
8:37 - Check GPU Specifications
9:47 - Closing & Outro

Grow your YouTube Channel with vidIQ vidiq.com/70s

More DigitalOcean Server Guides (Playlist) youtube.com/playlist?list=PLco3v23oibTVxAf_Ok3alkWKn-LriJxJR

Ubuntu Linux Tutorials (Playlist) youtube.com/playlist?list=PLco3v23oibTXMcX9Eh80_8OcnVs1SqsR2

Artificial Intelligence (AI), Machine Learning (ML), And Large Language Models (LLMs) Tutorials (Playlist) youtube.com/playlist?list=PLco3v23oibTU0B9gyOoNfFHBk4XlvWTgB

NVIDIA Graphics Card (GPU) Guides (Playlist) youtube.com/playlist?list=PLco3v23oibTXXYLoW6QWcje_7ASjxLQ4k

Social Media
SUBSCRIBE youtube.com/@Websplaining?sub_confirmation=1
Instagram (Thumbnail Collection) instagram.com/websplaining
X (For Newest uploads) https://x.com/websplaining
Reddit (Discussions) reddit.com/r/Websplaining
Personal Website websplaining.com

#NVIDIA #GPU #DigitalOcean

DONT FORGET TO LIKE, COMMENT, AND SUBSCRIBE!
How To Create A NVIDIA H100 GPU Cloud Server To Run And Train AI, ML, And LLMs Apps On DigitalOceanHow To Create A Virtual Private Server (VPS) Or Cloud Server On KamateraHow To Check RAM Usage On Ubuntu Linux TerminalHow To Sign Up And Use Proton Calendar For FREEHow To Enable Or Disable The Google Play Store App On AndroidHow To Test And Verify If your YubiKey Is Genuine And Functioning As DesignedHow To Run Session Messenger AI Agent Using OpenClaw or Hermes Agent with OpenCode Go SubscriptionHow To Request To Increase Your Server Account Quota On KamateraHow To Cancel PayPal Automatic Pre-Approved Payments (Autopay) And Reoccurring SubscriptionsHow to Toggle On or Off Use Adaptive Sound to improve sound quality on AndroidHow to delete Signal messages or conversions on AndroidHow To Check NVIDIA GPU Specification Information On Ubuntu Linux Command Line Terminal
Websplaining |

How To Create A NVIDIA H100 GPU Cloud Server To Run And Train AI, ML, And LLMs Apps On DigitalOcean

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER