How to avoid rounding error

3 visualizzazioni (ultimi 30 giorni)
Jiapeng
Jiapeng il 17 Set 2022
Modificato: Chris il 17 Set 2022
If I want to get the value of sqrt(10001),and it should to be 100.00499...
However, MATLAB shows 100.005.
How should I write the code to get 100.00499...
THANK YOU

Accedi per rispondere a questa domanda.

Risposta accettata

Chris
Chris il 17 Set 2022
Modificato: Chris il 17 Set 2022
Ran in:
Matlab is simply truncating the displayed value for ease of reading.
format longG
sqrt(10001)
ans =
100.004999875006
In both cases, the actual value matlab holds in memory is within +/- epsilon of the true value. Epsilon can be calculated like so:
eps(sqrt(10001))
ans =
1.4210854715202e-14

Più risposte (0)

Categorie

Scopri di più su Get Started with MATLAB in Help Center e File Exchange

Tag

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by