ServeTheHome | NVIDIA's Crazy 2022-23 Data Center CPUs, GPUs, and NICs @ServeTheHomeVideo | Uploaded March 2022 | Updated October 2024, 5 minutes ago.
We go into what was announced, and the Easter eggs found in the NVIDIA GTC 2022 keynote. We cover the NVIDIA H100 (Hopper), SXM H100, DGX H100, HGX H100 8 GPU, NVLink Switch, DGX Pod, NVIDIA Grace, Grace-Hopper, Grace-2xHopper, NVIDIA Eos supercomputer, Quantum Infiniband, Spectrum Ethernet, NVIDIA AGX Orin, NVIDIA Clara, NVLink C2C, NVIDIA Ovx, NVIDIA A40, NVIDIA Spectrum-3, Spectrum-4, Infiniband, ConnectX-7, and more.

If that sounds crazy, it is. We even get into liquid cooling and air cooling, and some of the bits that NVIDIA showed only for a second or two like the potential use of Intel Xeon Sapphire Rapids chips. This video is long, so use chapters to navigate.

How to win that 3080 Ti (closes soon): servethehome.com/nvidia-geforce-rtx-3080-ti-gtc-2022-giveaway

STH Main Site Article: servethehome.com/nvidia-gtc-2022-keynote-coverage-crazy-new-data-center-gear
STH Merch on Spring: the-sth-merch-shop.myteespring.co
STH Top 5 Weekly Newsletter: eepurl.com/dryM09
STH Forums: forums.servethehome.com

----------------------------------------------------------------------
Where to Find STH
----------------------------------------------------------------------
STH Forums: forums.servethehome.com
Follow on Twitter: twitter.com/ServeTheHome

----------------------------------------------------------------------
Other STH Content Mentioned in this Video
----------------------------------------------------------------------
- Liquid Cooling 8x NVIDIA A100 Servers: youtu.be/4Np1HnWiHb4
- Inspur 8x A100 Delta Server: youtu.be/E6HJi0iqYbw
- Tyan's 10x GPU Server: youtu.be/20WROEwCkRg
- Supermicro NVIDIA A100 Redstone: youtu.be/WdvLGhIdzl8
- Dell PowerEdge XE8545 A100 Redstone: youtu.be/IFHm8MV8l8U
- ASUS PCIe A100 Server: youtu.be/1Mva2Qd5LSQ
- 8x NVIDIA V100 in HGX: youtu.be/2FV5zHO1z1M
- Installing 8x NVIDIA P100 SXMs: youtu.be/ipQXdjjAPGg
- NVIDIA A40 Review: servethehome.com/nvidia-a40-48gb-gpu-mini-review
- AMD EPYC 7773X Review: youtu.be/oUugk0INTRU
- 32-port 400GbE Innovium Switch: youtu.be/p1qmvr-VYw8
- Ultimate Cluster-in-a-Box with BlueField-2 DPUs: youtu.be/3ZBEgNB1-mk
- DPU SmartNIC: youtu.be/tOeketsa96I
- Dell's 200GbE Switch: youtu.be/EzRvKRNXdh8
- NVIDIA GTC 2021
- Intel Ponte Vecchio: youtu.be/8peF7QuLC2M

----------------------------------------------------------------------
Timestamps
----------------------------------------------------------------------
00:00 Introduction
02:10 NVIDIA H100 Hopper Chip
03:38 What makes the H100 Faster
04:48 H100 FP8 Support
06:03 Transformer Engine Surprise
07:04 H100 MIG and Confidential Computing
09:13 NVIDIA H100 SXM Module
10:26 NVSwitch in DGX without cooling but showing liquid cooling
10:57 NVLink and NVIDIA Sharp
11:21 DGX CPUs and ConnectX-7 Easter Eggs
13:48 NVLink Switch System
16:22 NVIDIA EOS Supercomputer
18:34 ConnectX-7 plus Hopper H100
20:47 NVIDIA Grace Hopper and Grace Superchip
26:47 Grace-2xHopper is HUGE
28:21 NVLink C2C and Semi-Custom Chip IP
29:37 NVIDIA Spectrum-4 400GbE Switch
30:44 NVIDIA Dual Atlan AV and Hyperion 9 for Autonomous Vehicles
31:11 NVIDIA Clara for Medical
31:31 NVIDIA Isaac and NVIDIA AGX Orin
32:00 Two Mystery Cards in the musical outro
32:54 Wrapping-up