<p>I am trying to configure ceph on kubernetes cluster using rook, I have run the following commands:</p>
<pre><code>kubectl apply -f common.yaml
</code></pre>
<pre><code>kubectl apply -f operator.yaml
</code></pre>
<pre><code>kubectl apply -f cluster.yaml
</code></pre>
<p>I have three worker nodes with atached volumes and on master, all the created pods are running except the rook-ceph-crashcollector pods for the three nodes, when I describe these pods I get this message</p>
<pre><code>MountVolume.SetUp failed for volume &quot;rook-ceph-crash-collector-keyring&quot; : secret &quot;rook-ceph-crash-collector-keyring&quot; not found
</code></pre>
<p>However all the nodes are running and working</p>

<p>It is hard to exactly tell what might be the cause of this but there are few possibilities:</p>
<ul>
<li><p>Cluster networking problem between nodes</p>
</li>
<li><p>Some possible leftover sockets in the <code>/var/lib/kubelet</code> directory related to rook ceph.</p>
</li>
<li><p>A bug when connecting to an external Ceph cluster.</p>
</li>
</ul>
<p>In order to fix your issue you can:</p>
<ul>
<li><p>Use Flannel and make sure it is using the right interface. Check the <code>kube-flannel.yml</code> file and see if it uses the <code>--iface=</code> option. Or alternatively try to use Calico.</p>
</li>
<li><p>Clear the <code>./var/lib/rook/</code>, <code>./var/lib/kubelet/plugins/</code> and <code>./var/lib/kubelet/plugins_registry/</code> directories and reinstall the rook service.</p>
</li>
<li><p>Create the <code>rook-ceph-crash-collector-keyring</code> secret manually by executing: <code>kubectl -n rook-ceph create secret generic rook-ceph-crash-collector-keyring</code>.</p>
</li>
</ul>
