Improper negative number representation
Mostra commenti meno recenti
I have encountered a very strange issue. I was having trouble with an if statement that was comparing two numbers. Although the numbers were apparently identical, the equality was seen as false. I dug a little deeper and I found this extremely simple minimal working example. Why is this happening? This doesn't make any sense!
>> format long
>> A = -6*1e-9
A =
-6.000000000000001e-09
2 Commenti
Vittorio Picco
il 11 Nov 2020
David Hill
il 11 Nov 2020
Floating point numbers! There is lots of matlab documentation on floating point numbers, you just need to search for it.
Risposta accettata
Più risposte (0)
Categorie
Scopri di più su Physics in Centro assistenza e File Exchange
Prodotti
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!