Distributed ML on consumer devices @GPUMODE

Distributed ML on consumer devices @GPUMODE

Uploaded March 2026 | Updated September 2026, 40 minutes ago

Speaker: Matt Beton

Distributed ML on consumer devices

Lecture 60: Optimizing Linear Attention

Lecture 8: CUDA Performance Checklist

Lecture 16: On Hands Profiling

Lecture 17: NCCL

Lecture 96: TLX

Lecture 113: Every Microsecond Matters: Achieving Near Speed-of-Light Latency in GPU Collectives

Production Megakernels for Real-World Inference

Live Quartet 4 bit training

Lecture 24: Scan at the Speed of Light

Lecture 80: How FlashAttention 4 Works

Lecture 39: Torchtitan

Distributed ML on consumer devices

🔇 TAP TO UNMUTE