<p>A good way to evaluate an RL agent is to run it in the environment for N times, and calculate the average return from the N runs.</p>

<p>It is common to perform the above evaluation step throughout your training process, and graph the average return as training happens. You would expect the average return to go up, indicating that the training is doing something useful.</p>

<p>For example, in Figure 3 of the <a href="https://arxiv.org/pdf/1707.06347.pdf" rel="nofollow noreferrer">PPO paper</a>, the authors graphed the average return with training steps, to show that PPO performs better than other algorithms.</p>
How do you evaluate a trained reinforcement learning agent whether it is trained or not?
<p>I am new to reinforcement learning agent training. I have read about PPO algorithm and used stable baselines library to train an agent using PPO. So my question here is how do I evaluate a trained RL agent. Consider for a regression or classification problem I have metrics like r2_score or accuracy etc.. Are there any such parameters or how do I test the agent, conclude that the agent is trained well or bad.</p>

<p>Thanks</p>