hmm, but then we would have to make the call to the setter conditional in the training plugins.   For example, in DDPSpawnPlugin we use the setter to update the global rank once we have spawned the new processes. 