GitLab

Add tools folder

See merge request !214

Merge remote-tracking branches 'origin/eof-events', 'origin/image-entrypoint', 'origin/allgo-files-var', 'origin/prevent-option-injections' and 'origin/db-migration' into qualif

A malicious user may submit an input file starting with '-'.
A loosely-implemented webapp entrypoint could misinterpret
it as a command-line option a let the user inject arbitrary
options to the commands executed inside the job.

To prevent this the leading '-' in input filenames are silently
changed into '_'.

Now that users can push their image to the registry, it is much more
straightforward to let them configure the app entrypoint with an
ENTRYPOINT directive in the Dockerfile.

Note: if the image has no entrypoint, then we fall back to the global
entrypoint defined in the webapp (Webapp.entrypoint)

because currently the client cannot tell if a stream was normally or
prematurely terminated (the only reliable approach is to repeat the
request, which is not good)

- the submission order is preserved
- Job.files is a JSON list so that we can expand it later to store
  other details
- in ALLGO_FILES the filenames are line-delimited to allow working
  with input files containing spaces in their name (the IFS env var
  can be tuned for that purpose)

close allgo.inria.fr#11

support edition/deletion/restoration of webapp versions

Closes allgo.inria.fr#5, #44, and #266

See merge request !206

fixes for the qualif deployment

Closes #356, #349, #345, #309, allgo.inria.fr#8, #347, #338, allgo.inria.fr#7, allgo.inria.fr#5, and #44

See merge request !205

add webapp deploy tokens

Closes allgo.inria.fr#5 and #44

See merge request !204

add api endpoint to stream job state updates and logs

Closes allgo.inria.fr#6

See merge request !208

Ignore the image entrypoint when creating job/sandbox containers

See merge request !207

(because it is more common)

Given that user can now push any docker images (!204), we will
have troubles if the user sets an arbitrary entrypoint (eg: using
the ENTRYPOINT instruction in the Dockerfile).

It is wiser to just ignore the entrypoint for the moment.

Note: in the future, we should remove Webapp.entrypoint and use the
ENTRYPOINT defined in the image instead.

- implement the deletion and restoration of webapp versions
- add the WebappVersionUpdate form to:
  - update version fields: number, description, published
  - restore a recently deleted version

- make WebappVersionList a pure list (remove the form) and add control
  buttons to edit/delete/restore the versions
- add the WebappVersion.deleted_at to record the deletion time
- rename the state 'REPLACED' as 'DELETED' (because versions can now be
  deleted explicitley by the user)
- use a common WebappVersionForm for the WebappVesionUpdate and
  WebappSandboxPanel views
- reuse the previous 'published' status by default when replacing
  a version in the sandbox panel
- add the 'ALLGO_EXPUNGE_DELAY' configure when the deleted images are
  destroyed for real

commit 5311d3a7
Author: LETORT Sebastien <sebastien.letort@irisa.fr>
Date:   Tue Sep 17 09:29:45 2019 +0200

    WebappVersion.webapp related_name changed from 'webapp' to 'version'.

commit 0f68b0e0
Merge: 7aa839c4 8a251945
Author: LETORT Sebastien <sebastien.letort@irisa.fr>
Date:   Mon Sep 16 12:08:26 2019 +0200

    Merge branch 'django' into 266-allow-unpublished-webapp-version

commit 7aa839c4
Author: LETORT Sebastien <sebastien.letort@irisa.fr>
Date:   Mon Sep 16 12:07:00 2019 +0200

    Several fixes after code review.
    query_webapps_for_user doesn't have the only_published_version param anymore.
    comment explains the filtering with 'webapp__published'.
    debug log comment are removed.
    WebappVersion in error state are show to the user.
    WebappVersionList.get_queryset return query_set and not values.
    no more mention of atomic transaction.
    WebappVersionList.post: var name correction.

commit ab7107e3
Author: LETORT Sebastien <sebastien.letort@irisa.fr>
Date:   Mon Jul 22 12:19:55 2019 +0200

    sugar +/- PEP8 syntax correction.
    remove useless else in helpers.query_webapps_for_user

commit e32ec378
Author: LETORT Sebastien <sebastien.letort@irisa.fr>
Date:   Mon Jul 22 11:13:54 2019 +0200

    update of query_webapps_for_user, specially when used by views.WebappList.
    Now the user cannot view public app if no version is published.

commit 55061286
Merge: 5a2b0b7e 979954ef
Author: LETORT Sebastien <sebastien.letort@irisa.fr>
Date:   Mon Jul 1 14:12:17 2019 +0200

    Merge branch 'django' into 266-allow-unpublished-webapp-version

commit 5a2b0b7e
Merge: b7f1b67c ffa355b0
Author: sebastien letort <sletort@capri.irisa.fr>
Date:   Fri Apr 19 10:16:16 2019 +0200

    Merge branch 'django' into 266-allow-unpublished-webapp-version

commit b7f1b67c
Author: sebastien letort <sletort@capri.irisa.fr>
Date:   Fri Apr 19 10:15:27 2019 +0200

    Published status of version can now be updated.
    I used @transaction atomic to make all the update in one access to the DB (so speed up). But there is no constraint for that.

commit ddf2cf17
Author: sebastien letort <sletort@capri.irisa.fr>
Date:   Wed Apr 17 14:05:42 2019 +0200

    list all versions available for an app.
    The app owner will be able to update published status, not yet implemented.

commit d2d6176a
Author: sebastien letort <sletort@capri.irisa.fr>
Date:   Tue Apr 16 11:11:21 2019 +0200

    The owner of an app can run job on unpublished webapp (it appears in the list of available version).

commit 0c053a2d
Merge: a8c1d1d4 610f9c90
Author: sebastien letort <sletort@capri.irisa.fr>
Date:   Mon Apr 15 15:21:42 2019 +0200

    Merge branch 'django' into 266-allow-unpublished-webapp-version

commit a8c1d1d4
Author: sebastien letort <sletort@capri.irisa.fr>
Date:   Mon Apr 15 13:54:04 2019 +0200

    Webapp version can now be commited 'unpublished'.

commit 22799031
Author: sebastien letort <sletort@capri.irisa.fr>
Date:   Tue Apr 2 16:12:50 2019 +0200

    Only the published webapp versions are shown in the jobCreate view.

(to avoid collapsing it on smaller screen)

Various fixes for the next release

Closes #356, #349, #345, #309, allgo.inria.fr#8, #347, #338, and allgo.inria.fr#7

See merge request !203

- add the Token model to store the authentication tokens
- add the WebappTokenCreate & WebappTokenDelete views to manage
  the tokens
- enable the docker panel in the WebappSandboxPanel
- rename the jwt token class 'Token' as 'JwtToken'
  (to avoid any confusion)
- enable access to the registry (only for pushing for the moment)

close #44
close allgo.inria.fr#5
mitigates #227