Azzera filtri
Azzera filtri

How to use double precision in deep learning toolbox?

11 visualizzazioni (ultimi 30 giorni)
It seems like deep learning toolbox has defalut set single precision. I want double precision in my neural network, how to achieve this? Please Help!
  2 Commenti
Matt J
Matt J il 12 Nov 2023
Are you saying you want to train in double precision, or just do inference in double precision?
Rohan Mahala
Rohan Mahala il 13 Nov 2023
Both actually, train as well as inference in double precision.

Accedi per commentare.

Risposte (1)

Angelo Yeo
Angelo Yeo il 14 Nov 2023
I understand that you want to use trainNetwork and trainnet to train and predict in double precision This is currently not possible in MATLAB R2023b. Internally, 'trainnet' defaults to single precision and hence cannot be used in this case. This functionality is something the developers are actively working on for a future release.
A workaround is to use a custom training loop. You can refer the following example for a general reference -
1. Once the learnable network parameters are initialized, they must be converted to type double by using 'dlupdate'
net = dlupdate(@double, net);
2. Ensure data is double precision. This can be set using the 'OutputCast' of 'minibatchqueue' to 'double'. Note that this parameter is read-only. It cannot be modified after construction of 'minibatchqueue'.
Please also note that it is not possible to train in double precision if you are using DAGNetwork or SeriesNetwork.
  1 Commento
Rohan Mahala
Rohan Mahala il 26 Dic 2023
I am not using 'trainnet', instead I am using acclerated custom training loop.
I did the OutputCast of 'minibatchqueue' to 'double' and now I am getting the predictions in double cast, However i am not able to achieve the desired accuracy.
Can you please suggest me some other pointers to keep in mind so that the training happens correctly in 'double' precision mode only.

Accedi per commentare.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by