Confusion between real-world and floating-point values
1 visualizzazione (ultimi 30 giorni)
Mostra commenti meno recenti
Life is Wonderful
il 4 Ago 2022
Commentato: Life is Wonderful
il 4 Ago 2022
Hello there,
I'm converting floating to real-world data values with the code snippet below.
I notice that after scaling, floating point values are no longer fractional, implying that data loss has occurred.
Thank you in advance
fi(linspace(-5,5,10),true,32,28)
storedInteger(fi(linspace(-5,5,10),true,32,28))
storedInteger(fi(linspace(-5,5,10),true,32,28)) / 2 ^28
I'm expecting fractional length, but I'm wondering where it's gone. Thanks !!
0 Commenti
Risposta accettata
Walter Roberson
il 4 Ago 2022
You forgot to take into account that an integer data type operated on with a double precision number, returns the integer data type
fi(linspace(-5,5,10),true,32,28)
SI = storedInteger(fi(linspace(-5,5,10),true,32,28))
class(SI)
SI / 2^28
double(SI) / 2^28
Più risposte (0)
Vedere anche
Categorie
Scopri di più su Fixed-Point Designer in Help Center e File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!