<p>I try to run kubeflow samples (pipelines/pytorchjob etc) but it stacks as <code>ContainerCreating</code>.</p>

<p>For this purpose, I want to see dockershim and docker logs.
Is there any documentation?</p>

<p>sample code is follows
<a href="https://github.com/kubeflow/pipelines/tree/master/samples/core/helloworld" rel="nofollow noreferrer">https://github.com/kubeflow/pipelines/tree/master/samples/core/helloworld</a></p>

<pre class="lang-sh prettyprint-override"><code>kubectl create serviceaccount pipeline-runner
python3 hello_world.py
kubectl create -f hello_world.py.yaml
</code></pre>

<pre class="lang-sh prettyprint-override"><code>$ kubectl describe workflow.argoproj.io/my-first-pipeline-wgkg2
Name:         my-first-pipeline-wgkg2
Namespace:    default
Labels:       workflows.argoproj.io/phase=Running
Annotations:  pipelines.kubeflow.org/pipeline_spec: {"description": "A hello world pipeline.", "name": "My first pipeline"}
API Version:  argoproj.io/v1alpha1
Kind:         Workflow
Metadata:
  Creation Timestamp:  2020-04-22T00:11:41Z
  Generate Name:       my-first-pipeline-
  Generation:          3
  Resource Version:    23748
  Self Link:           /apis/argoproj.io/v1alpha1/namespaces/default/workflows/my-first-pipeline-wgkg2
  UID:                 50acafe4-2254-4dea-865d-7ec03496e523
Spec:
  Arguments:
  Entrypoint:            my-first-pipeline
  Service Account Name:  pipeline-runner
  Templates:
    Container:
      Args:
        echo "hello world"
      Command:
        sh
        -c
      Image:  library/bash:4.4.23
      Name:
      Resources:
    Inputs:
    Metadata:
    Name:  echo
    Outputs:
    Dag:
      Tasks:
        Arguments:
        Name:      echo
        Template:  echo
    Inputs:
    Metadata:
    Name:  my-first-pipeline
    Outputs:
Status:
  Finished At:  &lt;nil&gt;
  Nodes:
    my-first-pipeline-wgkg2:
      Children:
        my-first-pipeline-wgkg2-3423630397
      Display Name:   my-first-pipeline-wgkg2
      Finished At:    &lt;nil&gt;
      Id:             my-first-pipeline-wgkg2
      Name:           my-first-pipeline-wgkg2
      Phase:          Running
      Started At:     2020-04-22T00:11:41Z
      Template Name:  my-first-pipeline
      Type:           DAG
    my-first-pipeline-wgkg2-3423630397:
      Boundary ID:    my-first-pipeline-wgkg2
      Display Name:   echo
      Finished At:    &lt;nil&gt;
      Id:             my-first-pipeline-wgkg2-3423630397
      Message:        ContainerCreating
      Name:           my-first-pipeline-wgkg2.echo
      Phase:          Pending
      Started At:     2020-04-22T00:11:41Z
      Template Name:  echo
      Type:           Pod
  Phase:              Running
  Started At:         2020-04-22T00:11:41Z
Events:               &lt;none&gt;
</code></pre>

<p><code>kubectl logs</code>are follows</p>

<pre class="lang-sh prettyprint-override"><code>$ kubectl logs my-first-pipeline-wgkg2-3423630397 -c wait
Error from server (BadRequest): container "wait" in pod "my-first-pipeline-wgkg2-3423630397" is waiting to start: ContainerCreating
$ kubectl logs my-first-pipeline-wgkg2-3423630397 -c main
Error from server (BadRequest): container "main" in pod "my-first-pipeline-wgkg2-3423630397" is waiting to start: ContainerCreating
</code></pre>

Atsushi Sakai
<p>After you are in the worker nodes you can do <code>docker ps</code> to find out <code>containerid</code> for the container and then to see logs <code>docker logs containerid</code> command should be useful.</p>

<p>Also look at kubelet logs in the worker nodes to see if there is any issue by running command <code>journalctl -u kubelet.service -f</code> in the worker nodes.</p>
