Why Computers Get Math Wrong - Tech History @599CD
Why Computers Get Math Wrong - Tech History  @599CD
Uploaded November 2026 | Updated November 2026, 1 day ago
In today's video, we explain why Math Wrong results like 0.1 + 0.2 can produce unexpected decimals in computers. We will cover binary floating point, rounding, precision limits, equality comparisons, calculation order, IEEE standards, and real-world consequences of numerical errors. We will also discuss how Excel formatting differs from stored values, when to use integers, decimal types, or currency, and how to choose appropriate rounding and comparison tolerances.

CHAPTERS:
00:00 Introduction
01:05 Repeating Decimals And Finite Representation
01:49 Why Decimal Tenths Repeat In Binary
04:19 How Floating-Point Numbers Work
05:08 Precision Limits And Calculation Order
07:04 IEEE 754 And Special Values
08:36 Real-World Consequences Of Precision Errors
09:19 Excel, Access, And Money Calculations
11:52 Comparing Floating-Point Values With Tolerance
13:06 Conclusion

BECOME A MEMBER:
YouTube: youtube.com/channel/UCl7-jJie4ifOVK87FINIuDg/join
or My Site: 599cd.com/THMember

LEARN MORE:
Math Wrong: 599cd.com/MathWrong



KEYWORDS:
Tech History, #learn, #computer, #pc, #technology, #history, #tech, floating point precision, 0.1 + 0.2, IEEE 754, binary representation of decimals, rounding error, floating point equality, Excel precision as displayed, Patriot missile failure, Access Currency vs Double, NaN and infinity, binary64

QUESTIONS:
Please feel free to post your questions or comments below. Thanks.
Live long, and prosper.
Why Computers Get Math Wrong - Tech HistoryCan You Turn An Access Database Into An EXE?How to Use the On Paint Event in Microsoft Access Forms to Supplement Conditional FormattingWas Paradox Really Better Than Access?Does Microsoft Access Save Form Edits When You Move to Another Record? Video Quiz B1.10Stop Making Your Access Menu Hard To UseAutomate Your ACCDE Build ProcessThe Truth About Microsoft Access and Why It Dominated Desktop DatabasesGrandma Could Kill Your Online ConnectionTreat AI Like A Junior AssistantWhy Does Microsoft Access Show Security Warnings for Downloaded Databases? Video Quiz B2.1Fixing the Duplicate Record Macro Error in Microsoft Access Paste Isnt Available Command Fix
Computer Learning Zone |

Why Computers Get Math Wrong - Tech History

SHARE TO X SHARE TO REDDIT SHARE TO FACEBOOK WALLPAPER