Possibility to have variable in config files
It could be nice to have name that contains some information related to hyperparameters.
For instance, if we could do something like it would be great:
run_name_format: "run_{model_name}_{network['name']}_{network['param1']}_{batch_size}_foo_{run_id}"
and
model_filename_format: '{run_name}_{checkpoint}_{len(learn_params)}_net.pth'
or harder maybe:
evaluation_interval: '640000 / 10 / {batch_size}' # training sample / evaluation steps / batch size
So, basically, any variable defined in the config file exists in the variable space, like it is the case for model_name
or run_name
.
I don't know how hard is it to implement, the last 2 examples being a bit more challenging I guess. So obviously, this is not high priority, but could be an enjoyable UX improvements.