Once installed, add
hydra/launcher=submitit_slurm to your command line. Alternatively, override
hydra/launcher in your config:
Note that this plugin expects a valid environment in the target host. usually this means a shared file system between the launching host and the target host.
Submitit actually implements 2 different launchers:
submitit_slurm to run on a SLURM cluster, and
submitit_local for basic local tests.
You can discover the SLURM Launcher parameters with:
Similarly, you can discover the local launcher parameters with:
You can set all these parameters in your configuration file and/or override them in the commandline:
Caution: use of
--multirun is required for the launcher to be picked up.
An example application using this launcher is provided in the plugin repository.
Starting the app with
python my_app.py task=1,2,3 --multirun (see Multi-run for details) will launch 3 executions (you can override the launcher to run locally for testing by adding
You will be able to see the output of the app in the output dir: