Single versus double precision, what's going on here?

23 Lug 2013
1 Risposta
Risposta accettata
9 Visualizzazioni (30 giorni)

0 voti

Why does: >> 14+18300+200000+5000000+550000000
ans =
555218314
But: >> single(14)+single(18300)+single(200000)+single(5000000)+single(550000000)
ans =
555218304
Am I missing something? Thanks!

1 Commento
Mostra -1 commenti meno recenti Nascondi -1 commenti meno recenti

Matt H
Matt H il 23 Lug 2013
Answer: In single precision, the fraction only contains 23 bits, so there 2^(23+1) for the maximum value, before you start losing precision at the integer level. So 2^24 = 16777216. >> single(16777216)
ans =
16777216
>> single(16777217)
ans =
16777216

Accedi per commentare.

Accedi per rispondere a questa domanda.

 Risposta accettata

dpb
dpb il 23 Lug 2013

0 voti

Hint--(a very large one :) )
single(550000000)+single(5000000)+single(200000)+single(18300)
ans = ???

Più risposte (0)

Categorie

Scopri di più su Operators and Elementary Operations in Centro assistenza e File Exchange

Tag

Richiesto:

Matt H
Matt H
il 23 Lug 2013

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by