Proposal: early stopping mechanism
At the moment, Fed-BioMed doesn't provide an early stopping mechanism. I think it would be a good option to have it in 2 versions:
- Locally, so basically checking the local loss on the local updates
- Globally, based on the variation of the loss among different training rounds
The user could provide both the number of steps and the sensibility threshold as a training argument.