Mentions légales du service

Skip to content
Snippets Groups Projects
  • BIGAUD Nathan's avatar
    a50b810f
    Implement abstract and gaussian noise-addition optimizer modules. · a50b810f
    BIGAUD Nathan authored and ANDREY Paul's avatar ANDREY Paul committed
    
    * Implement `GaussianNoiseModule`, to enable adding gaussian noise
      to step-wise batch-averaged gradients as part of local DP-SGD or
      to clients-averaged updates as part of central DP-SGD.
    * Implement an abstract `NoiseModule` layer, paving the way for
      other noise-addition mechanisms.
    
    This commit squashes some incremental work by multiple authors:
    * Nathan Bigaud implemented `GaussianNoiseModule` after doing the
      scientific and technical review of requirements, notably as to
      the use of a cryptographically-safe RNG.
    * Paul Andrey abstracted part of the code into the `NoiseModule`
      class, fixed some pending todos, and adjusted unit tests.
    
    Co-authored-by: default avatarPaul Andrey <paul.andrey@inria.fr>
    a50b810f
    History
    Implement abstract and gaussian noise-addition optimizer modules.
    BIGAUD Nathan authored and ANDREY Paul's avatar ANDREY Paul committed
    
    * Implement `GaussianNoiseModule`, to enable adding gaussian noise
      to step-wise batch-averaged gradients as part of local DP-SGD or
      to clients-averaged updates as part of central DP-SGD.
    * Implement an abstract `NoiseModule` layer, paving the way for
      other noise-addition mechanisms.
    
    This commit squashes some incremental work by multiple authors:
    * Nathan Bigaud implemented `GaussianNoiseModule` after doing the
      scientific and technical review of requirements, notably as to
      the use of a cryptographically-safe RNG.
    * Paul Andrey abstracted part of the code into the `NoiseModule`
      class, fixed some pending todos, and adjusted unit tests.
    
    Co-authored-by: default avatarPaul Andrey <paul.andrey@inria.fr>