Can ChatGPT reason mathematically? @DrTrefor
Can ChatGPT reason mathematically?  @DrTrefor
Uploaded November 2024 | Updated November 2026, 19 hours ago
AI Researchers at Apple just released a new paper that breaks down limitations in the ability of Large Language Models (LLMs) like ChatGPT to reason mathematically.
The paper: arxiv.org/pdf/2410.05229
AI researchers analyze the mathematical reasoning ability of LLMs using a database of math questions called GSM8k for Grade School Math. What the apple researchers did was to tweak this database by first changing names and numbers, second making problems longer with more clauses at the same reasoning level, and finally by adding irrelevant clauses that should be ignored. Each of these caused some level of problems, but it was the irrelevant clauses that were most challenging to even top LLMs like chatgpt o1-mini and o1-preview.

The video of grade 8 students: youtube.com/watch?v=kibaFBgaPx4&ab_channel=RobertKaplinsky
Twitter thread from Mehrdad Farajtabar, one of the authors: https://x.com/MFarajtabar/status/1844456880971858028

BECOME A MEMBER:►Join: youtube.com/channel/UC9rTsvTxJnx1DNrDA3Rqa6A/join

MATH BOOKS I LOVE (affilliate link):
► amazon.com/shop/treforbazett

COURSE PLAYLISTS:
►DISCRETE MATH: youtube.com/playlist?list=PLHXZ9OQGMqxersk8fUxiUMSIx0DBqsKZS
►LINEAR ALGEBRA: youtube.com/playlist?list=PLHXZ9OQGMqxfUl0tcqPNTJsb7R6BqSLo6
►CALCULUS I: youtube.com/playlist?list=PLHXZ9OQGMqxfT9RMcReZ4WcoVILP4k6-m
► CALCULUS II: youtube.com/playlist?list=PLHXZ9OQGMqxc4ySKTIW19TLrT91Ik9M4n
►MULTIVARIABLE CALCULUS (Calc III): youtube.com/playlist?list=PLHXZ9OQGMqxc_CvEy7xBKRQr6I214QJcd
►VECTOR CALCULUS (Calc IV) youtube.com/playlist?list=PLHXZ9OQGMqxfW0GMqeUE1bLKaYor6kbHa
►DIFFERENTIAL EQUATIONS: youtube.com/playlist?list=PLHXZ9OQGMqxde-SlgmWlCmNHroIWtujBw
►LAPLACE TRANSFORM: youtube.com/playlist?list=PLHXZ9OQGMqxcJXnLr08cyNaup4RDsbAl1
►GAME THEORY: youtube.com/playlist?list=PLHXZ9OQGMqxdzD8KpTHz6_gsw9pPxRFlX

OTHER PLAYLISTS:
► Learning Math Series
youtube.com/watch?v=LPH2lqis3D0&list=PLHXZ9OQGMqxfSkRtlL5KPq6JqMNTh_MBw
►Cool Math Series:
youtube.com/playlist?list=PLHXZ9OQGMqxelE_9RzwJ-cqfUtaFBpiho

SOCIALS:
►X/Twitter: http://X.com/treforbazett
►TikTok: tiktok.com/@drtrefor
►Instagram (photography based): instagram.com/treforphotography
Can ChatGPT reason mathematically?Solving the Gaussian Integral the cool wayEvery proof technique except actually proving itSpherical Loaf of BreadThe Look & Say sequence is so cool5 proofs every math major should knowTheorem on Friends & StrangersThe Braid GroupDid I make a 4D bubble?!?My back to school routine as a PROFESSOR  |  One week until classes start!Why Small World Graphs Are Awesome // #SoME4 Guest VideoStokes Theorem Example // Verifying both Sides // Vector Calculus
Dr. Trefor Bazett |

Can ChatGPT reason mathematically?

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER