Bonus Lecture: CUDA C++ llm.cpp @GPUMODE

Bonus Lecture: CUDA C++ llm.cpp @GPUMODE

Uploaded April 2024 | Updated September 2026, 3 hours ago

llm.cpp: github.com/gevtushenko/llm.c
Slides: drive.google.com/drive/folders/1T-t0d_u0Xu8w_-1E5kAwmXNfF72x-HTA?usp=sharing

Bonus Lecture: CUDA C++ llm.cpp

Lecture 35: SGLang

Lecture 69: Quartet 4 bit training

TIRx

Lecture 52: Scaling Laws for Low Precision

Lecture 66: Game Arena

Proving Kernels Correct Instead of Testing Them

How FlashAttention 4 Works

Lecture 20: Scan Algorithm

Livestream: Outperforming cuBLAS on H100

Mirage (MPK): Compiling LLMs into Mega Kernels

Lecture 114: PyCuTe

Bonus Lecture: CUDA C++ llm.cpp