Mentions légales du service

Skip to content
Snippets Groups Projects

Deep Learning tutorial

This repository contains materials for the Deep Learning tutorial of the Intuidoc team.

Connecting to IGRIDA

Prerequisite

You will need a working ssh with private and public key pairs.

For Windows users:

Install git for windows https://git-scm.com/downloads. This will install Git Bash with the three programs you will need: ssh, ssh-keygen and ssh-copy-id.

Next, launch git bash and create your private/public keys with ssh-keygen and copy them to the sabre.irisa.fr server with ssh-copy-id:

ssh-keygen -t rsa
ssh-copy-id -i ~/.ssh/id_rsa.pub $USER@sabre

Maintenant, vous pouvez vous connecter sur le front-end de la grille en utilisant la commande:

ssh $USER@igrida-oar-frontend

Launching IGRIDA jobs for the tutorial

In order to launch jobs on IGRIDA, you need to submit jobs using the oarsub command:

# create the job
oarsub -S -t timesharing -l /nodes=1/core=4/gpu_device=1,walltime=01:30:0 scripts/run_igrida_staller.sh
# connect to it using the OAR_JOB_ID, you can list your jobs with oarstat -u
oarsub -C JOB_ID

You can find the script scripts/run_igrida_staller.sh here.

More info at http://igrida.gforge.inria.fr/

Clone the project

You can now clone the project on igrida with git:

cd where_ever_you_want
git clone https://gitlab.inria.fr/kchoi/Deep_Learning_tutorial.git

Load python environment and the jupyter notebook

You can source the python environment using the following command:

# replace gpu by cpu if on an cpu only node
source /temp_dd/igrida-fs1/kchoi/miniconda3/bin/activate gpu

Next, run the jupyter notebook from which we will be doing the tutorial:

jupyter notebook --ip=* --no-browser
# output

[W 20:14:43.648 NotebookApp] WARNING: The notebook server is listening on all IP addresses and not using encryption. This is not recommended.
[I 20:14:43.681 NotebookApp] Serving notebooks from local directory: /udd/user
[I 20:14:43.681 NotebookApp] 0 active kernels
[I 20:14:43.682 NotebookApp] The Jupyter Notebook is running at:
[I 20:14:43.682 NotebookApp] http://[all ip addresses on your system]:8888/?token=ad046861594b9231e8f9c82860e7b25ca13d7637aee7aee5
[I 20:14:43.682 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[C 20:14:43.684 NotebookApp]

    Copy/paste this URL into your browser when you connect for the first time,
    to login with a token:
        http://localhost:8888/?token=ad046861594b92...

Follow the output of the command and connect to the link http://igrida-abacus:8888/?token=ad046861594b923.... Remember to replace localhost to the server you actually are running a job on.

Once you have loaded the jupyter notebook on your browser, you can start the tutorial by the opening the first notebook.

That's all for now, happy tutorial!