i trust you tested with buildbot debug  did you verify that it actually submitted the changes  i think you need to provide a fake pickle now with mock slave status to get it to actually submit changes  this used to be automatic but was not anymore  