this post was submitted on 06 Jul 2025
1166 points (98.6% liked)

Greentext

6653 readers
1962 users here now

This is a place to share greentexts and witness the confounding life of Anon. If you're new to the Greentext community, think of it as a sort of zoo with Anon as the main attraction.

Be warned:

If you find yourself getting angry (or god forbid, agreeing) with something Anon has said, you might be doing it wrong.

founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] needanke@feddit.org 14 points 1 day ago* (last edited 23 hours ago) (2 children)

(I don't think that was your teachers point at all, but) couldn't the different formulas have produced different rounding errors due to floating point percision?

[–] funkless_eck@sh.itjust.works 19 points 23 hours ago (1 children)

Excel has a 15 point float, a quadrillionth, which should be enough for anything you were using excel for.

yeah because excel does rounding stuff automatically for you

try entering 0.1 + 0.2 - 0.1 - 0.2 == 0.0 in any programming language of your choice and see what happens.

[–] Blackmist@feddit.uk 13 points 23 hours ago (1 children)

Doubtful, but if anything mine would be more accurate. Fewer calculation steps to lose precision on. I think most spreadsheet software fudges floating point precision anyway. A computer programmer may accept that 0.1+0.2 is not 0.3 but an accountant or mathematician would not be having it.

I think she was just shit at maths tbh. As a kid you sort of assume all the teachers know more than you about every subject, and that's not the case at all.

As a kid you sort of assume all the teachers know more than you about every subject, and that’s not the case at all.

same for chatgpt