Why MTP Made Ornith 35B Slower on Essays #shorts @KGPTalkie
Why MTP Made Ornith 35B Slower on Essays #shorts  @KGPTalkie
Uploaded September 2026 | Updated November 2026, 20 hours ago
MTP made Qwen 3.8 more than 2 times faster. But on essay writing, it made Ornith slower.

MTP means multi-token prediction. A small draft head guesses the next few tokens, and the full model checks those guesses in one go.
▸ Guess right → you get extra tokens
▸ Guess wrong → that compute is wasted

▸ On JSON: Qwen 3.8 got 2.3× the speed with MTP, Ornith 35B got only 1.1×
▸ On essays: Ornith 35B dropped to 0.7×, so it became slower
▸ Why? On essays, the guesses are right only around 30% of the time

So test MTP on your own content first.

Will you test MTP? Tell me in the comments 👇
Follow for more AI benchmarks.

#MTP #LLM #AI #Shorts #Qwen #LocalLLM #AIBenchmark

Full benchmark: kgptalkie.com/tutorials/llm-benchmarking/ornith-1-5-9b-vs-35b-a3b-benchmark
Why MTP Made Ornith 35B Slower on Essays #shortsStock Exchange System Design: How Orders Get Matched05 Gen AI Interview Preparation: Multi-Agent vs Single Agent Gen AI System Design  #ai #codingLLM Token Cost: Why the Hindi Bill Comes Out HigherClaude Usage Tracker System Design: 5-Hour + Weekly LimitsTokenization in LLM: 4 Quirks That Confuse ModelsVocabulary Size vs Context Window: Why 128K Means Two Things | LLM ConceptsQwen 3.8 on Ollama vs Muse Glimmer vs Gemma 4 - Local LLM Coding Test on OllamaI Ran Qwen 3.8 Flash Next (Qwen 4) on CPU OnlyInstagram Feed System Design: Interview Question ExplainedProduction RAG for Finance with Qwen 3.8 27B: Fully Local Ollama + Qdrant (Live)AI Chatbot Hallucination: The Bot Promised the Wrong Refund | AI System Design Interview
Laxmi Kant | KGP Talkie |

Why MTP Made Ornith 35B Slower on Essays #shorts

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER