In this paper, we study this in the classic setting where the unknown environment is modelled as a Markov Decision Process (MDP).
we focus on developing an algorithm that combines effective exploration with neural network function approximation.