Speed up 'dlgradient' with parallelism?

Hi all,

I am wondering if there is a way to speed up the 'dlgradient' function evaluation using parallelism or GPUs.

Answer 1

[Jon Cherrie]

You can use a GPU for the dlgradient computation by using a gpuArray with dlarray.

In this example, the minibtachqueue, puts data on to the GPU and thus the GPU is used for the rest of the computation, both the "forward" pass the "backward" (gradient) pass:

• https://www.mathworks.com/help/deeplearning/ug/train-network-using-custom-training-loop.html?#TrainNetworkUsingCustomTrainingLoopExample-5