<p>In the meantime I figured out how to use the 2 APIs together. The trick is to pass a 5D-Tensor as input to tf.nn.dynamic_rnn(), where the last dimension is the size of the "vector on the spatial grid" (which comes from the transformation of the input from 2D to 3D, inspired by the paper on which the implementation is based: <a href="https://arxiv.org/pdf/1506.04214.pdf" rel="nofollow noreferrer">https://arxiv.org/pdf/1506.04214.pdf</a>). In my case the vector size is 1, I have to expand the dimension anyway though.</p>

<p>While fixing this error another issue emerged: In the paper mentioned above in section 3.1 they state the equations for the convLSTM. They use the Hadamard-product for weights connected to the cell outputs C. Printing the weights of my ConvLSTMCell in Tensorflow, it seems like they don't use the weights Wci, Wcf and Wco at all. So, can anybody tell me the exact implementation of the TF ConvLSTMCell?</p>

<p>Btw. the output of the tensorflow ConvSTMCell is C or H (in the notation of the paper)?</p>
ValueError: ConvLSTMCell and dynamic_rnn
<p>I'm trying to build a seq2seq model in tensorflow (1.4) using the tf.contrib.rnn.ConvLSTMCell API together with the tf.nn.dynamic_rnn API, but I got an error with the dimension of the inputs.</p>

<p>My code is:</p>

<pre><code># features is an image sequence with shape [600, 400, 10], 
# so features is a tensor with shape [batch_size, 600, 400, 10]

features = tf.transpose(features, [0,3,1,2])
features = tf.reshape(features, [params['batch_size'],10,600,400])   

encoder_cell = tf.contrib.rnn.ConvLSTMCell(conv_ndims=2,
                                           input_shape=[600, 400,1],
                                           output_channels=5,
                                           kernel_shape=[7,7],
                                           skip_connection=False)

_, encoder_state = tf.nn.dynamic_rnn(cell=encoder_cell,
                                     inputs=features,
                                     sequence_length=[10]*params['batch_size'],
                                     dtype=tf.float32)
</code></pre>

<p>I get the following error </p>

<pre><code>ValueError: Conv Linear expects all args to be of same Dimension: [[2, 600, 400], [2, 600, 400, 5]]
</code></pre>

<p>Looking at the tf implementation, it seems that the inputs to dynamic_rnn is only 3-dimensional in contrary to the hidden state, which is 4-dimensional. I tried to pass the input as a nested tuple, but it didn't work.</p>

<p>The problem is similar to <a href="https://stackoverflow.com/questions/42513613/tensorflow-dynamic-rnn-regressor-valueerror-dimension-mismatch">TensorFlow dynamic_rnn regressor: ValueError dimension mismatch</a>, it's slightly different though, as they're using a plain LSTMCell (which worked for me). </p>

<p>Can anyone give me a minimal example how to use these 2 APIs together? 
Thanks!</p>