Utilizing Multiple GPUs in MATLAB

Hello everyone.

I recently finalized a program utilizing GPU computing. My computations require 3 matrices, but as of right now, I need to send these matrices to a single GPU for the calculations to work. However, I am interested in utilizing multiple GPUs. For instance, sending each matrix to a different GPU but still being able to run the same computation, or using a 2nd GPU if I max out the memory on the first. Is this even possible?

Your answer will be appreciated very much.

Ben

Answer 1

[Sean de Wolski]

It depends. Do the first and second matrices (who live on different GPUs) need to interact (e.g. multiply together)? Or do you just need some results from them, e.g. the svd of each matrix?

Since the matrices will live on separate GPUs, you cannot have them interact with each other. If you just need to do the same calculations for different matrices, then multiple GPUs in parallel could help.