Why Qwen Was 3 Times Slower Than Ornith (Its Not Generation) #shorts @KGPTalkie
Why Qwen Was 3 Times Slower Than Ornith (Its Not Generation) #shorts  @KGPTalkie
Uploaded September 2026 | Updated November 2026, 4 days ago
On a 128K token document, Qwen 3.8 took 75 seconds to answer. Ornith took just 25. Why?

LLM generation speed is only half the story. How fast your model reads the prompt also matters. This is known as prefill.

▸ Ornith 1.5 9B reads around 10,000 tokens per second, so a 10,000 token prompt is processed in 1 second
▸ Qwen 3.8 27B reads 3,000 tokens per second, so the same 10,000 token prompt takes 3 seconds
▸ On a 128K token document, Qwen spends much more time just reading. That's why it was 3 times slower

Overall latency depends on both: reading speed and writing speed.

What do you check first, reading or writing speed? Tell me in the comments 👇
Follow for more AI benchmarks.

Full benchmark: kgptalkie.com/tutorials/llm-benchmarking/ornith-1-5-9b-vs-35b-a3b-benchmark

#LLM #AI #Shorts #Prefill #Qwen #LocalLLM #AIBenchmark
Why Qwen Was 3 Times Slower Than Ornith (Its Not Generation) #shortsAnythingLLM: Chat with Your PDFs Offline with Ollama (Free, No Account)10 Concatenation and Sorting - Numpy Crash Course for Data Science | Numpy for Machine LearningI Ran Google MedGemma 1.5 on My PC 🤯 Best Free Medical AI Yet?UPI Payment System DesignOrder State Machine: Delivered, Then Picked Up Again?Fable 5.2 vs Gemini 4 Argon: Same Score, 5x Cheaper?Quick and Simple Sentiment Analysis App in PythonNemotron 3.5 Lightning 33B vs Claude Haiku 5.5: Is Fast Also Good?NumPy Crash Course for Machine Learning | Arrays, Indexing, Operations and More02 RAGWire RAG Tutorial: Multi Company RAG for Financial Comparison using OllamaBPE vs WordPiece vs SentencePiece: Whats the Difference? | LLM Interview
Laxmi Kant | KGP Talkie |

Why Qwen Was 3 Times Slower Than Ornith (It's Not Generation) #shorts

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER