Distributed and parallel computing without DCS
4 views (last 30 days)
Is there a way to perform distributed computing across multiple computers without licensing Distributed Computing Server (DCS)? It is implied that Sun Grid Engine may be used without DCS, but my attempts to integrate torque+maui produce licensing errors. Which schedulers/resource managers are possible without the quite expensive (relative term, of course) DCS?
More Answers (4)
Thomas on 26 Oct 2011
Edited: Walter Roberson on 29 May 2015
In order to perform distributed computing across multiple computers you need the DCS license. We have DCS running with the Sun Grid Engine on our Cheaha cluster at UAB. The implication that SGE may be used with out the DCS is not correct. What I think was implied was that - You can use the SGE scheduler instead of the scheduler provided by the MATHWORKS (MATHWORKS job manager) along with the DCS.
Matlab page http://www.mathworks.com/products/distriben/supported/sched/ clearly states:
Grid Engine Family:
Sun N1 Grid Engine
Sample integration scripts are available with the
MATLAB Distributed Computing Server installation.
In short- you cannot use the distributed computing without the DCS.
You can use the parallel computing toolbox on your local multicore machine to use upto 12 workers to run in parallel with R2011b.
If you need help integrating DCS with SGE there are sample scripts available or you can contact MATHWORKS support.
Jason Ross on 26 Oct 2011
To add a little additional information: If you want to use Torque/PBS, you can do so with the direct integration from the Parallel menu, or using scripts similar to the ones for SGE if your environment won't allow the use of the direct integration.
Thomas and Anthony have already covered the licensing issues fairly thoroughly.
Konrad Malkowski on 29 Oct 2011
Starting with MATLAB R2010b MATLAB Compiler allows you to compile MATLAB code containing PARFOR and SPMD running on local scheduler.
The same limitations as with PCT local scheduler apply to compiled MATLAB applications.