Is inexact subtraction expected?

6 visualizzazioni (ultimi 30 giorni)
Guy
Guy il 18 Giu 2020
Risposto: Image Analyst il 18 Giu 2020
In Matlab R2018a, I just typed "32885.6-32760" and got back 125.599999999999. Is this type of inexact subtraction expected? If I then type "ans - 125" I get 0.599999999998545, so it's not just a bunch of 9's. Removing the leading 3 or the leading 32 does not give this incorrect answer (i.e. it gives the exact decimal value .6)

Accedi per rispondere a questa domanda.

Risposte (1)

Image Analyst
Image Analyst il 18 Giu 2020

Categorie

Scopri di più su Introduction to Installation and Licensing in Help Center e File Exchange

Tag

Prodotti

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by