    def softmax(y):
      """ simple helper function here that takes unnormalized logprobs """
      maxy = np.amax(y)
      e = np.exp(y - maxy)
      return e / np.sum(e)
simple helper function here that takes unnormalized logprobs
rl/pg_reinforce.py