- exceeding system RAM limits -- using virtual memory is many times slower than RAM, so you may go faster with fewer workers.
- Getting blocked on storage I/O -- CPUs sit idle waiting on files to be read or write, meaning that the problem is not CPU-bound.
How can I arrange the number of workers and number of computational threads?
7 visualizzazioni (ultimi 30 giorni)
Mostra commenti meno recenti
Jinsoo
il 4 Feb 2020
Commentato: Christopher McCausland
il 23 Nov 2022
Hello.
I'm using workstation of 44 cpu and 88 threads.
In this case, how can I arrange the number of workers and number of computational threads in Cluster Profile Manager?
Actually, I've arranged Number of workers (86) and Number of compuational threads (2).
However, I wonder whether it's the optimal setting or not.
Could you please let me know how to arrange it optimally?
I'm looking forward to hearing from you.^^
0 Commenti
Risposta accettata
Jason Ross
il 4 Feb 2020
Modificato: Jason Ross
il 4 Feb 2020
In my experience, the best performance comes from setting the number of workers to the number of real CPUs that you have, which should be the default. The workers end up waiting on the compute resources and there's no appreciable performance improvement, just more processes taking up more system resources.
The other things to watch for are
To optimize this you need to watch the system as it's running (there are plenty of graphical monitoring tools built into a modern OS), or save perfomance logs and then analyze them (these utilities have existed for a while on all platforms)
Other optimizations exist from analyzing your code with profiling tools and looking for ways to make slow sections of code faster.
4 Commenti
Christopher McCausland
il 23 Nov 2022
Sorry to bring this post back from the dead, but I was wondering if I could get your opinion on the number of threads (NumThreads). If NumWorkers = CPU cores I am assuming that NumThreads should = 1? I.e., Each CPU core will have a single thread?
Does having multiple GPU's within the compute node change any of your suggestions?
For full disclosure I have a cluster node with 2*20 core CPU's and 4*V100 GPUs which I am trying to optimise for MATLAB. The initial settings had NumWorkers = 2 and NumTreads = 4, but I do not think this optimises the setup? And finally, if I create gpuArray data, will MATLAB automatically use the GPU's avaliable or do I need to do anything else?
Kind regards,
Christopher
Più risposte (0)
Vedere anche
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!