Deep Learning tutorial
This repository contains materials for the Deep Learning tutorial of the Intuidoc team.
Connecting to IGRIDA
Prerequisite
You will need a working ssh
with private and public key pairs.
For Windows users:
Install git for windows https://git-scm.com/downloads.
This will install Git Bash
with the three programs you will need: ssh
, ssh-keygen
and ssh-copy-id
.
Next, launch git bash
and create your private/public keys with ssh-keygen
and copy them to the sabre.irisa.fr
server with ssh-copy-id
:
ssh-keygen -t rsa
ssh-copy-id -i ~/.ssh/id_rsa.pub $USER@sabre
Maintenant, vous pouvez vous connecter sur le front-end de la grille en utilisant la commande:
ssh $USER@igrida-oar-frontend
Launching IGRIDA jobs for the tutorial
In order to launch jobs on IGRIDA, you need to submit jobs using the oarsub
command:
# create the job
oarsub -S -t timesharing -l /nodes=1/core=4/gpu_device=1,walltime=01:30:0 scripts/run_igrida_staller.sh
# connect to it using the OAR_JOB_ID, you can list your jobs with oarstat -u
oarsub -C JOB_ID
You can find the script scripts/run_igrida_staller.sh
here.
More info at http://igrida.gforge.inria.fr/
Clone the project
You can now clone the project on igrida with git:
cd where_ever_you_want
git clone https://gitlab.inria.fr/kchoi/Deep_Learning_tutorial.git
Load python environment and the jupyter notebook
You can source the python environment using the following command:
# replace gpu by cpu if on an cpu only node
source /temp_dd/igrida-fs1/kchoi/miniconda3/bin/activate gpu
Next, run the jupyter notebook from which we will be doing the tutorial:
jupyter notebook --ip=* --no-browser
# output
[W 20:14:43.648 NotebookApp] WARNING: The notebook server is listening on all IP addresses and not using encryption. This is not recommended.
[I 20:14:43.681 NotebookApp] Serving notebooks from local directory: /udd/user
[I 20:14:43.681 NotebookApp] 0 active kernels
[I 20:14:43.682 NotebookApp] The Jupyter Notebook is running at:
[I 20:14:43.682 NotebookApp] http://[all ip addresses on your system]:8888/?token=ad046861594b9231e8f9c82860e7b25ca13d7637aee7aee5
[I 20:14:43.682 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[C 20:14:43.684 NotebookApp]
Copy/paste this URL into your browser when you connect for the first time,
to login with a token:
http://localhost:8888/?token=ad046861594b92...
Follow the output of the command and connect to the link http://igrida-abacus:8888/?token=ad046861594b923...
.
Remember to replace localhost
to the server you actually are running a job on.
Once you have loaded the jupyter notebook on your browser, you can start the tutorial by the opening the first notebook.
That's all for now, happy tutorial!