yeah, it's pretty bad. policy_map sets these 2 config bit when creating a new policy right now.  https://github.com/ray-project/ray/blob/master/rllib/evaluation/rollout_worker.py#L1808-L1809  I was trying to get rid of it, but couldn't really.  my plan for now is to set num_workers to num of deployment replicas, and set worker_index to replica index in serving ...