This MR tries to implement the explicit instructions from idiris for torch multi-node gpu support: http://www.idris.fr/eng/jean-zay/gpu/jean-zay-gpu-torch-multi-eng.html
Users would be expected to activate the JZ configuration by setting "setup_jz": true
in their dl_config
.