A recipe for 50x faster local LLM inference | AI & ML Monthly @mrdbourke
A recipe for 50x faster local LLM inference | AI & ML Monthly  @mrdbourke
Uploaded July 2025 | Updated November 2026, 1 day ago
Welcome to machine learning & AI monthly for June 2025.

This is the video version of the newsletter I write every month which covers the latest and greatest (but not always the latest) in the world of AI and ML.

Thumbnail paper link: huggingface.co/papers/2506.14111

Read the issues online:
- AI/ML Monthly June 2025 (this video) — zerotomastery.io/blog/ai-and-machine-learning-monthly-newsletter-june-2025
- AI/ML Monthly May 2025 — zerotomastery.io/blog/ai-and-machine-learning-monthly-newsletter-may-2025
- AI/ML Monthly April 2025 — zerotomastery.io/blog/ai-and-machine-learning-monthly-newsletter-april-2025

My links:
Download Nutrify (my startup) - https://nutrify.app
Download KeepTrack (my other startup) - https://keeptrack.app
Learn Hugging Face - dbourke.link/ZTM-HF-Text-Classification
Learn AI/ML (beginner-friendly course) - dbourke.link/ZTMMLcourse
Learn TensorFlow - dbourke.link/ZTMTFcourse
Learn PyTorch - dbourke.link/ZTMPyTorch
My ML blog - learnml.io
Read my novel Charlie Walks - charliewalks.com
Personal website - mrdbourke.com

Timestamps:
00:00 - Intro
00:25 - ZTM Object Detection with Hugging Face Transformers Project: learnhuggingface.com/notebooks/hugging_face_object_detection_tutorial
01:28 - KeepTrack is now an app: https://keeptrack.app
02:15 - The case for more ambition in AI research by Jack Morris: blog.jxmo.io/p/the-case-for-more-ambition
03:56 - Save money on AI audio transcriptions by speeding up the audio: https://george.mand.is/2025/06/openai-charges-by-the-minute-so-make-the-minutes-shorter/
06:16 - Answer.AI release ReadBench to test how well VLMs can read: answer.ai/posts/2025-06-05-readbench.html
9:06 - Flux.1 Kontext Release: bfl.ai/announcements/flux-1-kontext-dev
11:22 - Gemma 3n models designed to run on local devices released in full: huggingface.co/blog/gemma3n
18:05 - NuExtract 2.0 for structured data extraction: huggingface.co/collections/numind/nuextract-20-67c73c445106c12f2b1b6960
19:17 - 50x faster LLM inference recipe from Essential AI: huggingface.co/papers/2506.14111
23:32 - Qwen3 embedding and reranker models: huggingface.co/collections/Qwen/qwen3-embedding-6841b2055b99c44d9a4c371f
24:22 - BioCLIP 2: huggingface.co/imageomics/bioclip-2
29:34 - GLiNER-X series for any entity detection: huggingface.co/collections/knowledgator/gliner-x-684320a3f1220315c651d2f5
26:28 - V-JEPA 2: github.com/facebookresearch/vjepa2
30:58 - OCR edges towards its ChatGPT moment (Nanonets-OCR-s): nanonets.com/research/nanonets-ocr-s
34:12 - torchvista – visualizing PyTorch model flows: github.com/sachinhosmani/torchvista
35:22 - Ovis-U1-3B combines multimodal understanding, image generation and editing: huggingface.co/AIDC-AI/Ovis-U1-3B
38:29 - Baidu release the Ernie 4.5 foundation models: huggingface.co/collections/baidu/ernie-45-6861cd4c9be84540645f35c9
39:46 - Google Colab updates (Hugging Face integration & more): medium.com/google-colab/launch-hugging-face-models-in-colab-for-faster-ai-exploration-bee261978cf9
42:13 - Apple updates its on-device and server foundation models: machinelearning.apple.com/research/apple-foundation-models-2025-updates
49:16 - Anthropic guide on building a multi-agent research system: anthropic.com/engineering/built-multi-agent-research-system
49:30 - Google Gemini 2.5 Pro and Flash releases: developers.googleblog.com/en/gemini-2-5-thinking-model-updates
52:36 - Andrej Karpathy on Software 3.0, agents & more: youtu.be/LCEmiRjPEtQ?si=0mjoM5H9wlih_HdW
55:42 - Pivot to AI YouTube channel: youtube.com/@PivotToAI
56:04 - Nate B Jones YouTube channel: youtube.com/@NateBJones
A recipe for 50x faster local LLM inference | AI & ML MonthlyHow to go from tired to energized in 5-minutes (follow along workout)Ranking the Best Open Source AI Companies for 2025 + Open Source Model of the YearBedroom Floor 10-minute Upper Body Bodyweight Workout (intermediate)Got a chair? Try this 10-minute bodyweight only upper body workoutLearn TensorFlow and Deep Learning fundamentals with Python (code-first introduction) Part 2/2Learn PyTorch for deep learning in a day. Literally.What does a head of data science look for in a junior? | Interview with Ken JeeBeginner Friendly 20-minute Whole Body Bodyweight Only WorkoutSetup Mac for Machine Learning with PyTorch in 11 minutes (works for all M1, M2)Setup Mac for Machine Learning with TensorFlow in 13 minutes (works for all M1, M2)End-to-End (small) Vision Language Model Fine-tuning Tutorial | On DGX Spark
Daniel Bourke |

A recipe for 50x faster local LLM inference | AI & ML Monthly

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER