
\subsection{Q-functions}

We can't use value functions, so we use Q-values instead.

\(Q(s,a)\) is the value of taking action \(a\) in state \(s\).

\(Q(s,a)=R_{s,a}+\gamma E_{s'}[max_{a'}Q(s',a')]\).


assigned to every action/state combination), to real. h on q tables, q-values

