BIGAUD Nathan authored 2 years ago and ANDREY Paul committed 1 year ago

* Separating `split_data` and `quickrun`
* Improving doc and leveraging better existing doc
* Using fire for parsing

- Move functional data loading/saving utils to it.
- Properly deprecate `InMemoryDataset.(load|save)_data_array`.
- Improve docstrings formatting and exhaustiveness.

BIGAUD Nathan authored 2 years ago and ANDREY Paul committed 1 year ago

* Creating "ModelConfig","DataSplitConfig", and "ExperimentConfig"
* Relocating and updating parser to accept toml file as input
* Update split data to use config input
* Modularization and updating of run.py
* Small changes to MNIST toml example

- Previously, the predictions would come from the final hidden state
  of the trained LSTM, rather than the output representation of the
  final sequence element.
- This barely has any consequence given the nature of the unit tests,
  but improves readability when used as a template for RNN models or
  similar tests with other model frameworks.

Refactor 'TorchModel' backend code to compute sample-wise gradients.

See merge request !42

* Cache the functorch-built vmapped functions that compute (and opt.
  clip) sample-wise gradients.
* When available, use `functorch.compile` to try and optimize these
  functions (resulting in lower execution runtimes on repeated calls
  thanks to their caching).
* Note: with the release of torch-2.0, the `functorch.compile` API,
  which is experimental as of torch-1.13, is already deprecated.
  Hence this patch is going to be short-lived - but it may in turn
  pave the way to the future backend changes to add support for and
  take advantage of new torch-2.0 features.

Compute coverage as part of CI/CD.

See merge request !38

* Add 'pytest-cov' (hence, indirectly, 'coverage') to third-party
  dependencies of test environments.
* Add configuration of 'coverage' to properly target declearn code
  (excluding auto-generated protobuf code as well as `test_utils`
  submodule) and be compatible with the use of multiprocessing in
  some functional~integration tests.

Improve the test suite

See merge request !39