Fix signs in Scaffold documentation
In our documentation of the Scaffold implementation, on step 11 "update model with one optimizer step" we have a += sign but really it should be a -= (corresponding to what's implemented in the optimizer.step method in pytorch).
In addition, given the latest bug that was fixed by Paul's MR !197 (merged) , the definition of \delta
is also wrong.
Also, it would be nice to add a link to the following diagram (with corrected signs)
Edited by CREMONESI Francesco