Commit aa467e53 authored by MAUPETIT Charly's avatar MAUPETIT Charly

adding license

parent 9324e89b
This diff is collapsed.
_ | | _____ ____
/\ | | | | / ____|/ __ \
/ \ | | | | | | __| | | |
/ /\ \ | | | | | | |_ | | | |
/ ____ \| |____ | | | |__| | |__| |
/_/ \_\______| | | \_____|\____/
#What is Allgo (A||Go)
A||Go est une infrastructure web pour mettre en ligne le plus rapidement et simplement
possible des logiciels ou prototypes scientifiques. L'objectif est de réduire le coût du transfert de
l'ordinateur du chercheur vers les utilisateurs finaux (membre de l’équipe, communauté
scientifique,Startup PME, grand public).
Le déploiement des applications, et surtout leurs utilisations, s'en retrouvent simplifiés. On peut les exécuter via l'interface web ou une API HTTP.
Techniquement, A||Go est basé sur le framework Ruby on Rails pour offrir une interface web
et des services HTTP REST, ainsi que l’utilisation de Docker pour la gestion des images applicatives.
Docker fournit des conteneurs Linux pour gérer / stocker / utiliser les applications que nous
Un job est l'action d'exécuter une application, avc un ou plusieurs fichier(s) qui retournera un résultat.
## Woody (web server) - Debian 8
### What
Allgo frontend via the web application in RoR. We also have the datastore on Woody, to store files from jobs, and the SQL database.
### Need
Ruby 2.2.2-dev, Nginx, mariadb, ruby + rails via rvm, rails app (via capistrano), redis, git, zip, curl, sudo
### How
su -c "adduser allgo"
su -c "usermod -aG sudo allgo"
su allgo
Use RVM to install the correct version of Ruby
\curl -sSL | bash
rvm install ruby-2.2.2-dev
rvm --default use ruby-2.2.2-dev
Install the gem bundler to download the dependancies
gem install bundler
sudo apt-get install mariadb-devel redis -y
sudo service redis enable (to launch at boot)
sudo service redis start
sudo service mariadb enable
sudo service mariadb start
To run the project you need to migrate the project's database, there are backup in db/backup
rake db:create ( RAILS_ENV=production )
rake db:migrate ( RAILS_ENV=production )
Then launch the project and check if there is no error message in the correct port:
rails s
We also need to run sidekiq separately :
bundle exec sidekiq (-e production)
### What
The worker are server that will execute job created by users in Allgo.
we sent the command through ssh from Woody and send a docker pull request to cargo (see below)
the datastore from woody is mount through ssh so Worker can write in.
### Need
Docker 1.6, openssh-server
### How
su -c "apt-get update && apt-get install sudo openssh-server -y"
su -c "adduser allgo"
su -c "usermod -aG sudo allgo"
su allgo
Install the last docker version docker :
curl + curl -sSL | sh
sudo usermod -aG docker allgo
/etc/init.d/docker start
Try a Docker command to see if it works:
docker ps
If it is not the case:
sudo chown allgo /home/allgo/.docker/
sudo chown allgo /home/allgo/.docker/key.json
*Allowing insecure registry*
As we do not have an HTTPS certification yet, you need to allow an insecure registry in cargo server (see below) :
####Debian < v8
sudo nano /etc/default/docker
Then modify the line concerning DOCKER_OPTS to have: ```DOCKER_OPTS="--insecure-registry"```.
(or myregistry:5000 if development or other server)
#####Debian >= v8
sudo nano /lib/systemd/system/docker.service
Change one line to have ```ExecStart=/usr/bin/docker --insecure-registry myregistry:5000 -d -H fd://```
sudo systemctl daemon-reload
sudo /etc/init.d/docker restart
##Sid - Sandbox
It's the same as worker, but we use it when an user install an application/algorithm.
We create the docker image and push it to the registry
Cargo run the docker image registry, which allow us to store our own docker images.
We use a NAS to replicate the created images, it's safer.
Install docker (same as above)
*To run the registry, with external storage*
docker pull registry
docker run -d -p 5000:5000 -e SETTING_FLAVOR=dev -e STORAGE_PATH=/the_folder_of/your_choice_on_container/ -v /the_folder_of/your_choice/on_host:/the_folder_of/your_choice_on_container/ registry:latest
It's unsecure for the moment.
#The development environment :
You can use the Vagrantfile for Virtualbox (no provisioning yet)
Or follow those instructions :
Create 4 or 5 VM (depends of if you want to use your host as web server)
Add in VirtualBox second host-only adapter in the Network tab, with DHCP.
Relaunch your VM and modify the network interfaces:
sudo nano /etc/network/interfaces
Add in the opened file:
auto eth0
iface eth0 inet dhcp
auto eth1
iface eth1 inet dhcp
Once you've done the modifications, use the command ``sudo /etc/init.d/networking restart`` to restart the network card of your VM.
When duplicating the first worker don't forget to check the option to change the MAC address. Run a ```sudo ifconfig``` on each machine to get the IP address and copy-paste them into ``config/environments/development.rb`` in the corresponding line of rails-allgo.
###Installing ssh
You'll use ssh a lot on the workers thus we need to install it on the workers and aloow Woody to do a ssh without having to enter a password. First, install openssh-server:
sudo apt-get install openssh-server
Then on Woody, assuming that you already have a ssh key, do this for the workers and Sid:
ssh allgo@192.168.56.<machine number> mkdir -p .ssh
cat ~/.ssh/ | ssh allgo@192.168.56.<machine number> 'cat >> .ssh/authorized_keys'
###Change the hostname of your machines
After cloning your machines, they'll all have the name worker 0. To change that:
sudo nano /etc/hostname
Change the name and then:
sudo /etc/init.d/ start
......@@ -86,7 +86,7 @@ Allgo::Application.configure do
config.restrict_email = ['','']
config.dockerfiles_path = '/tmp/' #where to store Dockerfile on local server
config.dockerfiles_sandbox_path = '/tmp/' #where to store Dockerfile on sandbox to create image
config.dockerfiles_sandbox_path = '/tmp/dockerfiles/' #where to store Dockerfile on sandbox to create image
config.webapp_demo_path = 'public/app/' #url where we store informations about app
config.root_url = ""
config.user = "allgo"
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment