<p>You can use a CNN:</p>

<ul>
<li>The input is then not 3 * w * h but (3*number of images) * w * h - so you can just concatenate the stuff in depth</li>
<li>The output is just an image instead of a class. So no flattening in between... or a reshape has to be added.</li>
</ul>

<p>Have a look at <a href="https://arxiv.org/abs/1605.06211" rel="nofollow noreferrer">
Fully Convolutional Networks for Semantic Segmentation</a> and Image-to-Image translation.</p>

<p>If you haven't seen it already: <a href="https://keras.io" rel="nofollow noreferrer">Keras</a> is pretty handy.</p>

<p>You might also be interested in the concept of <a href="https://en.wikipedia.org/wiki/Optical_flow" rel="nofollow noreferrer">Optical Flow</a></p>
How can I predict the next image from a series of images?
<p>I am planing to predict the next image from an image sequence. I have searched on the internet (Google/YouTube) for tutorials and for similar work. but I couldn't find any.
I want to know whether it is possible to find the pattern and predict the next image and can I find some tutorials for that.</p>