What Is Quantization? How AI Models Get Smaller & Faster @IBMTechnology
What Is Quantization? How AI Models Get Smaller & Faster  @IBMTechnology
Uploaded October 2026 | Updated November 2026, 11 hours ago
Learn more about Quantization here → https://ibm.biz/~NdqpU881V

Huge AI models come with huge memory requirements.Grace Ableidinger explains how quantization compresses LLMs using lower-precision formats like INT8 and INT4. Learn how model size, GPU memory, speed, and accuracy trade off during AI inference.

00:00 – Understand What Quantization Does
00:23 – See Why LLMs Need Quantization
00:51 – Connect AI Parameters to Memory Requirements
01:31 – Calculate the Memory Cost of a 70B LLM
02:13 – See How Quantization Reduces Precision
02:53 – Follow Quantization Layer by Layer
04:21 – Compare FP16, FP8, INT8 & INT4
05:34 – Balance Memory Savings with Model Accuracy
06:33 – Compare PTQ vs Quantization-Aware Training
07:17 – Choose the Right Quantization Tradeoff

AI news moves fast. Sign up for a monthly newsletter for AI updates from IBM → https://ibm.biz/~SLKUNTFaQ

AI was used in the creation of the transcript and metadata for this video.

#llm #aimodels #aiinference #machinelearning #aiengineering

---------------------------------------------------------------------------------------------------------
Find us on YouTube:
🔵 IBM Technology: youtube.com/@IBMTechnology
🔵 IBM: youtube.com/@IBM
🔵 IBM Developer: youtube.com/@IBMDeveloperAdvocates
What Is Quantization? How AI Models Get Smaller & FasterLLM & AI Agent Benchmarks vs Reality: Why AI Applications BreakWho’s afraid of an open-weight model? GLM, context bombing and post-Black Hat attacksHow KV Cache Speeds Up LLMs for Faster AI Models on GPUsOpenAI cancels Astra release, Sonnet 5.5 & what Meta Muse means for workWhat is an AI Code Generator? LLM Coding, Productivity, & RiskThe patching gap: Hacked fridges, AI ransomware and Mythos findsGLM-5.2: The real security risk? Plus: Vibe hunting, the end of CVSS and updates on Lightwell5 Best Practices for Building AI Agent SkillsHow AI Models Scale Beyond a Single GPU Across LLM WorkloadsWhat Air Gap Really Means💨Are Vector Databases Still Needed? RAG, AI Agents & Search
IBM Technology |

What Is Quantization? How AI Models Get Smaller & Faster

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER