title: How to copy gym environment?
body: <p><strong>Info:</strong> I am using OpenAI Gym to create RL environments but need multiple copies of an environment for something I am doing. I do not want to do anything like <code>[gym.make(...) for i in range(2)]</code> to make a new environment.</p>
  <p><strong>Question:</strong> Given one gym env what is the best way to make a copy of it so that you have 2 duplicate but disconnected envs?</p>
  <p>Here is an example:</p>
  <pre><code>import gym
  
  env = gym.make(&quot;CartPole-v0&quot;)
  new_env = # NEED COPY OF ENV HERE
  
  env.reset() # Should not alter new_env
  </code></pre>