How to limit rounding in matrix division
1 visualizzazione (ultimi 30 giorni)
Mostra commenti meno recenti
I've a 2D matrix with values ranging from about 40 to 100. I'm dividing each entry value by 98 and for some reason, it's rounding my answers to 0 and 1. How can I limit this and get more decimal places? Or even better, how can I store each entry as a fraction? The matrix dimensions are 3456x5184 uint8.
0 Commenti
Risposte (1)
Chris Turnes
il 15 Mar 2016
Your last sentence has the answer: your data type is uint8. Dividing a uint8 by a uint8 is going to give you another integer, so you won't get any decimal places.
Your options are to convert to either double or single and do the operation, or as you said you can store each entry as a fraction. Since they are uint8, every entry of the matrix will contain the numerator, and every denominator is 98 -- so you already have all of the information.
0 Commenti
Vedere anche
Categorie
Scopri di più su Logical in Help Center e File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!