title: SARSA in Reinforcement Learning
body: <p>I am coming across the SARSA algorithm in model-free reinforcement learning. Specifically, in each state, you would take an action <code>a</code>, and then observed a new state <code>s'</code>.</p>
  
  <p>My question is, if you don't have the state transition probability equation <code>P{next state | current state = s0}</code>, how do you know what your next state will be?</p>
  
  <p><strong>My attempt</strong>: do you simply try that action <code>a</code> out, and then observe from the enviroment?
  <a href="https://i.stack.imgur.com/EqCqr.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/EqCqr.png" alt="enter image description here"></a></p>