Adding new aggregator and making aggregator more generic
This MR contains SCAFFOLD implementation for pytorch only.
/!\ ATTENTION: we should have a chat on which branch to merge first: this one or num_updates
fixing correction states calculation (deepcopy required), fixing argument given to set_new_correction_states_dict
Question to the reviewer:
-
server_lr: does it make sense to default it to .01?set by default to 1.
Edited by BOUILLARD Yannick