primary school question!

16 visualizzazioni (ultimi 30 giorni)
Wenjuan
Wenjuan il 28 Nov 2020
Risposto: Image Analyst il 28 Nov 2020
well, a silly question
why 0.07*400 is not equal to 28?
see screenshot;

Accedi per rispondere a questa domanda.

Risposte (1)

Image Analyst
Image Analyst il 28 Nov 2020
Truncation error due to double's only using 64 bits instead of an infinite number of bits. It will be off a very small amount, eps(28). See the FAQ for a thorough discussion:
https://matlab.fandom.com/wiki/FAQ#Why_is_0.3_-_0.2_-_0.1_.28or_similar.29_not_equal_to_zero.3F

Categorie

Scopri di più su MATLAB in Help Center e File Exchange

Tag

Prodotti


Release

R2020a

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by