Lecture 60: Optimizing Linear Attention @GPUMODE

Lecture 60: Optimizing Linear Attention @GPUMODE

Uploaded June 2025 | Updated September 2026, 1 hour ago

Speaker: Songlin Yang

Lecture 60: Optimizing Linear Attention

Lecture 8: CUDA Performance Checklist

Lecture 16: On Hands Profiling

Lecture 17: NCCL

Lecture 96: TLX

Lecture 113: Every Microsecond Matters: Achieving Near Speed-of-Light Latency in GPU Collectives

Production Megakernels for Real-World Inference

Live Quartet 4 bit training

Lecture 24: Scan at the Speed of Light

Lecture 80: How FlashAttention 4 Works

Lecture 39: Torchtitan

Cornserve: Easy, Fast and Scalable Multimodal AI

Lecture 60: Optimizing Linear Attention

🔇 TAP TO UNMUTE