{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/minikube/issues/2619","repository_url":"https://api.github.com/repos/kubernetes/minikube","labels_url":"https://api.github.com/repos/kubernetes/minikube/issues/2619/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/minikube/issues/2619/comments","events_url":"https://api.github.com/repos/kubernetes/minikube/issues/2619/events","html_url":"https://github.com/kubernetes/minikube/issues/2619","id":306843756,"node_id":"MDU6SXNzdWUzMDY4NDM3NTY=","number":2619,"title":"kube-dns service not being started.","user":{"login":"jthomas","id":2322,"node_id":"MDQ6VXNlcjIzMjI=","avatar_url":"https://avatars2.githubusercontent.com/u/2322?v=4","gravatar_id":"","url":"https://api.github.com/users/jthomas","html_url":"https://github.com/jthomas","followers_url":"https://api.github.com/users/jthomas/followers","following_url":"https://api.github.com/users/jthomas/following{/other_user}","gists_url":"https://api.github.com/users/jthomas/gists{/gist_id}","starred_url":"https://api.github.com/users/jthomas/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jthomas/subscriptions","organizations_url":"https://api.github.com/users/jthomas/orgs","repos_url":"https://api.github.com/users/jthomas/repos","events_url":"https://api.github.com/users/jthomas/events{/privacy}","received_events_url":"https://api.github.com/users/jthomas/received_events","type":"User","site_admin":false},"labels":[{"id":778122702,"node_id":"MDU6TGFiZWw3NzgxMjI3MDI=","url":"https://api.github.com/repos/kubernetes/minikube/labels/lifecycle/rotten","name":"lifecycle/rotten","color":"604460","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2018-03-20T12:26:20Z","updated_at":"2018-10-27T05:13:07Z","closed_at":null,"author_association":"NONE","body":"<!-- Thanks for filing an issue! Before hitting the button, please answer these questions.-->\r\n\r\n**BUG REPORT** \r\n\r\nPlease provide the following details:\r\n\r\n**Environment**:\r\n\r\n**Minikube version** (use `minikube version`): minikube version: v0.23.0\r\n- **OS**: OS X 10.13.3\r\n- **VM Driver**: virtualbox\r\n- **ISO version**: v0.23.6\r\n\r\n**What happened**:\r\n\r\nContainers can't resolve hostnames but have external network access. DNS service is not running after starting cluster. Manually starting the service resolves the issue.\r\n\r\n**How to reproduce it** (as minimally and precisely as possible):\r\n\r\n```\r\n$ minikube start --cpus 2 --memory 4096 --kubernetes-version=v1.7.4\r\n```\r\n\r\n`kube-dns` is shown as enabled but service is not running.\r\n\r\n```\r\n$ minikube addons list\r\n- default-storageclass: enabled\r\n- coredns: disabled\r\n- heapster: disabled\r\n- ingress: disabled\r\n- registry: disabled\r\n- registry-creds: disabled\r\n- addon-manager: enabled\r\n- kube-dns: enabled\r\n- dashboard: enabled\r\n$ kubectl get pods --namespace=kube-system\r\nNAME                          READY     STATUS    RESTARTS   AGE\r\nkube-addon-manager-minikube   1/1       Running   0          16m\r\n```\r\n\r\nIf I follow the DNS debugging instructions [here](https://kubernetes.io/docs/tasks/administer-cluster/dns-debugging-resolution/), it demonstrates hostnames fail to resolve.\r\n\r\n```\r\n$ kubectl exec busybox cat /etc/resolv.conf\r\nnameserver 10.0.0.10\r\nsearch default.svc.cluster.local svc.cluster.local cluster.local\r\noptions ndots:5\r\n$  kubectl exec -ti busybox -- nslookup kubernetes.default\r\nServer:    10.0.0.10\r\nAddress 1: 10.0.0.10\r\n\r\nnslookup: can't resolve 'kubernetes.default'\r\ncommand terminated with exit code 1\r\n```\r\n\r\nIf I manually deploy the `kube-dns` service, using the config files [here](https://github.com/kubernetes/minikube/tree/54e1cc9df897939e1276f5e8d1996bd88f37c5ee/deploy/addons/kube-dns), DNS resolutions start working.\r\n\r\n```\r\n$ kubectl apply -f kube-dns-cm.yaml\r\nconfigmap \"kube-dns\" created\r\n$ kubectl apply -f kube-dns-controller.yaml\r\ndeployment \"kube-dns\" created\r\n$ kubectl apply -f kube-dns-svc.yaml\r\nservice \"kube-dns\" created\r\n$ kubectl get pods --namespace=kube-system\r\nNAME                          READY     STATUS    RESTARTS   AGE\r\nkube-addon-manager-minikube   1/1       Running   0          28m\r\nkube-dns-1326421443-sw3fp     3/3       Running   0          2m\r\n$ kubectl exec -ti busybox -- nslookup kubernetes.default\r\nServer:    10.0.0.10\r\nAddress 1: 10.0.0.10 kube-dns.kube-system.svc.cluster.local\r\n\r\nName:      kubernetes.default\r\nAddress 1: 92.242.132.16 unallocated.barefruit.co.uk\r\n```\r\n\r\n**Output of `minikube logs` (if applicable)**:\r\n\r\n```\r\n-- Logs begin at Tue 2018-03-20 11:52:50 UTC, end at Tue 2018-03-20 12:23:19 UTC. --\r\nMar 20 11:53:11 minikube systemd[1]: Starting Localkube...\r\nMar 20 11:53:11 minikube localkube[3373]: proto: duplicate proto type registered: google.protobuf.Any\r\nMar 20 11:53:11 minikube localkube[3373]: proto: duplicate proto type registered: google.protobuf.Duration\r\nMar 20 11:53:11 minikube localkube[3373]: proto: duplicate proto type registered: google.protobuf.Timestamp\r\nMar 20 11:53:11 minikube localkube[3373]: listening for peers on http://localhost:2380\r\nMar 20 11:53:11 minikube localkube[3373]: listening for client requests on localhost:2379\r\nMar 20 11:53:11 minikube localkube[3373]: name = default\r\nMar 20 11:53:11 minikube localkube[3373]: data dir = /var/lib/localkube/etcd\r\nMar 20 11:53:11 minikube localkube[3373]: member dir = /var/lib/localkube/etcd/member\r\nMar 20 11:53:11 minikube localkube[3373]: heartbeat = 100ms\r\nMar 20 11:53:11 minikube localkube[3373]: election = 1000ms\r\nMar 20 11:53:11 minikube localkube[3373]: snapshot count = 10000\r\nMar 20 11:53:11 minikube localkube[3373]: advertise client URLs = http://localhost:2379\r\nMar 20 11:53:11 minikube localkube[3373]: initial advertise peer URLs = http://localhost:2380\r\nMar 20 11:53:11 minikube localkube[3373]: initial cluster = default=http://localhost:2380\r\nMar 20 11:53:11 minikube localkube[3373]: starting member 8e9e05c52164694d in cluster cdf818194e3a8c32\r\nMar 20 11:53:11 minikube localkube[3373]: 8e9e05c52164694d became follower at term 0\r\nMar 20 11:53:11 minikube localkube[3373]: newRaft 8e9e05c52164694d [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]\r\nMar 20 11:53:11 minikube localkube[3373]: 8e9e05c52164694d became follower at term 1\r\nMar 20 11:53:11 minikube localkube[3373]: starting server... [version: 3.1.5, cluster version: to_be_decided]\r\nMar 20 11:53:11 minikube localkube[3373]: added member 8e9e05c52164694d [http://localhost:2380] to cluster cdf818194e3a8c32\r\nMar 20 11:53:12 minikube localkube[3373]: 8e9e05c52164694d is starting a new election at term 1\r\nMar 20 11:53:12 minikube localkube[3373]: 8e9e05c52164694d became candidate at term 2\r\nMar 20 11:53:12 minikube localkube[3373]: 8e9e05c52164694d received MsgVoteResp from 8e9e05c52164694d at term 2\r\nMar 20 11:53:12 minikube localkube[3373]: I0320 11:53:12.235742    3373 etcd.go:58] Etcd server is ready\r\nMar 20 11:53:12 minikube localkube[3373]: 8e9e05c52164694d became leader at term 2\r\nMar 20 11:53:12 minikube localkube[3373]: raft.node: 8e9e05c52164694d elected leader 8e9e05c52164694d at term 2\r\nMar 20 11:53:12 minikube localkube[3373]: localkube host ip address: 10.0.2.15\r\nMar 20 11:53:12 minikube localkube[3373]: Starting apiserver...\r\nMar 20 11:53:12 minikube localkube[3373]: Waiting for apiserver to be healthy...\r\nMar 20 11:53:12 minikube localkube[3373]: published {Name:default ClientURLs:[http://localhost:2379]} to cluster cdf818194e3a8c32\r\nMar 20 11:53:12 minikube localkube[3373]: ready to serve client requests\r\nMar 20 11:53:12 minikube localkube[3373]: serving insecure client requests on 127.0.0.1:2379, this is strongly discouraged!\r\nMar 20 11:53:12 minikube localkube[3373]: I0320 11:53:12.238550    3373 server.go:112] Version: v1.7.4\r\nMar 20 11:53:12 minikube localkube[3373]: W0320 11:53:12.238842    3373 authentication.go:368] AnonymousAuth is not allowed with the AllowAll authorizer.  Resetting AnonymousAuth to false. You should use a different authorizer\r\nMar 20 11:53:12 minikube localkube[3373]: setting up the initial cluster version to 3.1\r\nMar 20 11:53:12 minikube localkube[3373]: set the initial cluster version to 3.1\r\nMar 20 11:53:12 minikube localkube[3373]: enabled capabilities for version 3.1\r\nMar 20 11:53:12 minikube localkube[3373]: [restful] 2018/03/20 11:53:12 log.go:33: [restful/swagger] listing is available at https://10.0.2.15:8443/swaggerapi\r\nMar 20 11:53:12 minikube localkube[3373]: [restful] 2018/03/20 11:53:12 log.go:33: [restful/swagger] https://10.0.2.15:8443/swaggerui/ is mapped to folder /swagger-ui/\r\nMar 20 11:53:13 minikube localkube[3373]: I0320 11:53:13.245636    3373 ready.go:32] Performing healthcheck on https://localhost:8443/healthz\r\nMar 20 11:53:13 minikube localkube[3373]: E0320 11:53:13.248573    3373 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused\r\nMar 20 11:53:14 minikube localkube[3373]: I0320 11:53:14.239233    3373 ready.go:32] Performing healthcheck on https://localhost:8443/healthz\r\nMar 20 11:53:14 minikube localkube[3373]: E0320 11:53:14.243695    3373 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused\r\nMar 20 11:53:15 minikube localkube[3373]: I0320 11:53:15.245566    3373 ready.go:32] Performing healthcheck on https://localhost:8443/healthz\r\nMar 20 11:53:15 minikube localkube[3373]: E0320 11:53:15.248024    3373 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused\r\nMar 20 11:53:16 minikube localkube[3373]: I0320 11:53:16.239289    3373 ready.go:32] Performing healthcheck on https://localhost:8443/healthz\r\nMar 20 11:53:16 minikube localkube[3373]: E0320 11:53:16.241541    3373 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused\r\nMar 20 11:53:17 minikube localkube[3373]: I0320 11:53:17.251305    3373 ready.go:32] Performing healthcheck on https://localhost:8443/healthz\r\nMar 20 11:53:17 minikube localkube[3373]: E0320 11:53:17.255832    3373 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.241510    3373 ready.go:32] Performing healthcheck on https://localhost:8443/healthz\r\nMar 20 11:53:18 minikube localkube[3373]: E0320 11:53:18.242572    3373 ready.go:58] Error performing healthcheck: Get https://localhost:8443/healthz: dial tcp 127.0.0.1:8443: getsockopt: connection refused\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.662713    3373 serve.go:85] Serving securely on 0.0.0.0:8443\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.664100    3373 tprregistration_controller.go:144] Starting tpr-autoregister controller\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.664215    3373 controller_utils.go:994] Waiting for caches to sync for tpr-autoregister controller\r\nMar 20 11:53:18 minikube systemd[1]: Started Localkube.\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.670471    3373 apiservice_controller.go:113] Starting APIServiceRegistrationController\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.670491    3373 cache.go:32] Waiting for caches to sync for APIServiceRegistrationController controller\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.670511    3373 autoregister_controller.go:120] Starting autoregister controller\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.670518    3373 cache.go:32] Waiting for caches to sync for autoregister controller\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.670699    3373 available_controller.go:201] Starting AvailableConditionController\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.670708    3373 cache.go:32] Waiting for caches to sync for AvailableConditionController controller\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.671101    3373 crd_finalizer.go:248] Starting CRDFinalizer\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.673998    3373 customresource_discovery_controller.go:152] Starting DiscoveryController\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.674161    3373 naming_controller.go:284] Starting NamingConditionController\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.764516    3373 controller_utils.go:1001] Caches are synced for tpr-autoregister controller\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.771422    3373 cache.go:39] Caches are synced for APIServiceRegistrationController controller\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.771453    3373 cache.go:39] Caches are synced for autoregister controller\r\nMar 20 11:53:18 minikube localkube[3373]: I0320 11:53:18.771711    3373 cache.go:39] Caches are synced for AvailableConditionController controller\r\nMar 20 11:53:18 minikube localkube[3373]: E0320 11:53:18.819456    3373 autoregister_controller.go:167] v1beta1.apps failed with : Operation cannot be fulfilled on apiservices.apiregistration.k8s.io \"v1beta1.apps\": the object has been modified; please apply your changes to the latest version and try again\r\nMar 20 11:53:18 minikube localkube[3373]: E0320 11:53:18.822826    3373 available_controller.go:234] v1.authentication.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io \"v1.authentication.k8s.io\": the object has been modified; please apply your changes to the latest version and try again\r\nMar 20 11:53:18 minikube localkube[3373]: E0320 11:53:18.832748    3373 available_controller.go:234] v1alpha1.admissionregistration.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io \"v1alpha1.admissionregistration.k8s.io\": the object has been modified; please apply your changes to the latest version and try again\r\nMar 20 11:53:18 minikube localkube[3373]: E0320 11:53:18.836351    3373 available_controller.go:234] v1beta1.authentication.k8s.io failed with: Operation cannot be fulfilled on apiservices.apiregistration.k8s.io \"v1beta1.authentication.k8s.io\": the object has been modified; please apply your changes to the latest version and try again\r\nMar 20 11:53:18 minikube localkube[3373]: E0320 11:53:18.856287    3373 autoregister_controller.go:167] v1.batch failed with : Operation cannot be fulfilled on apiservices.apiregistration.k8s.io \"v1.batch\": the object has been modified; please apply your changes to the latest version and try again\r\nMar 20 11:53:19 minikube localkube[3373]: I0320 11:53:19.236462    3373 ready.go:32] Performing healthcheck on https://localhost:8443/healthz\r\nMar 20 11:53:19 minikube localkube[3373]: I0320 11:53:19.283969    3373 ready.go:67] Got healthcheck response: [+]ping ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/generic-apiserver-start-informers ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/start-apiextensions-informers ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/start-apiextensions-controllers ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/bootstrap-controller ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/extensions/third-party-resources ok\r\nMar 20 11:53:19 minikube localkube[3373]: [-]poststarthook/ca-registration failed: reason withheld\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/start-kube-apiserver-informers ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/start-kube-aggregator-informers ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/apiservice-registration-controller ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/apiservice-status-available-controller ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]poststarthook/kube-apiserver-autoregistration ok\r\nMar 20 11:53:19 minikube localkube[3373]: [+]autoregister-completion ok\r\nMar 20 11:53:19 minikube localkube[3373]: healthz check failed\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.239904    3373 ready.go:32] Performing healthcheck on https://localhost:8443/healthz\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.260082    3373 ready.go:67] Got healthcheck response: ok\r\nMar 20 11:53:20 minikube localkube[3373]: apiserver is ready!\r\nMar 20 11:53:20 minikube localkube[3373]: Starting controller-manager...\r\nMar 20 11:53:20 minikube localkube[3373]: Waiting for controller-manager to be healthy...\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.260655    3373 controllermanager.go:107] Version: v1.7.4\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.281278    3373 leaderelection.go:179] attempting to acquire leader lease...\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.314103    3373 leaderelection.go:189] successfully acquired lease kube-system/kube-controller-manager\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.316549    3373 event.go:218] Event(v1.ObjectReference{Kind:\"Endpoints\", Namespace:\"kube-system\", Name:\"kube-controller-manager\", UID:\"48e9476a-2c35-11e8-bd95-080027f6dbed\", APIVersion:\"v1\", ResourceVersion:\"71\", FieldPath:\"\"}): type: 'Normal' reason: 'LeaderElection' minikube became leader\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.378725    3373 plugins.go:101] No cloud provider specified.\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.382179    3373 controllermanager.go:439] Started \"cronjob\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.383781    3373 controllermanager.go:439] Started \"ttl\"\r\nMar 20 11:53:20 minikube localkube[3373]: W0320 11:53:20.383806    3373 core.go:114] Unsuccessful parsing of cluster CIDR : invalid CIDR address:\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.383816    3373 core.go:130] Will not configure cloud provider routes for allocate-node-cidrs: false, configure-cloud-routes: true.\r\nMar 20 11:53:20 minikube localkube[3373]: W0320 11:53:20.383820    3373 controllermanager.go:436] Skipping \"route\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.384171    3373 ttlcontroller.go:117] Starting TTL controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.384304    3373 controller_utils.go:994] Waiting for caches to sync for TTL controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.389325    3373 controller_utils.go:994] Waiting for caches to sync for tokens controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.390130    3373 controllermanager.go:439] Started \"persistentvolume-binder\"\r\nMar 20 11:53:20 minikube localkube[3373]: W0320 11:53:20.391459    3373 shared_informer.go:298] resyncPeriod 57993055485527 is smaller than resyncCheckPeriod 85932948753341 and the informer has already started. Changing it to 85932948753341\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.391547    3373 controllermanager.go:439] Started \"resourcequota\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.392852    3373 controllermanager.go:439] Started \"daemonset\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.394394    3373 controllermanager.go:439] Started \"deployment\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.397352    3373 controllermanager.go:439] Started \"horizontalpodautoscaling\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.398955    3373 controllermanager.go:439] Started \"csrapproving\"\r\nMar 20 11:53:20 minikube localkube[3373]: W0320 11:53:20.398977    3373 controllermanager.go:423] \"bootstrapsigner\" is disabled\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.400170    3373 controllermanager.go:439] Started \"attachdetach\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.401184    3373 controllermanager.go:439] Started \"endpoint\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.402252    3373 controllermanager.go:439] Started \"replicationcontroller\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.404361    3373 cronjob_controller.go:99] Starting CronJob Manager\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.414925    3373 pv_controller_base.go:271] Starting persistent volume controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.415036    3373 controller_utils.go:994] Waiting for caches to sync for persistent volume controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.415478    3373 resource_quota_controller.go:241] Starting resource quota controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.415569    3373 controller_utils.go:994] Waiting for caches to sync for resource quota controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.415949    3373 daemoncontroller.go:221] Starting daemon sets controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.416101    3373 controller_utils.go:994] Waiting for caches to sync for daemon sets controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.416398    3373 deployment_controller.go:152] Starting deployment controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.416528    3373 controller_utils.go:994] Waiting for caches to sync for deployment controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.416726    3373 horizontal.go:145] Starting HPA controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.416842    3373 controller_utils.go:994] Waiting for caches to sync for HPA controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.417057    3373 certificate_controller.go:110] Starting certificate controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.417187    3373 controller_utils.go:994] Waiting for caches to sync for certificate controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.417296    3373 attach_detach_controller.go:242] Starting attach detach controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.417391    3373 controller_utils.go:994] Waiting for caches to sync for attach detach controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.417667    3373 endpoints_controller.go:136] Starting endpoint controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.417796    3373 controller_utils.go:994] Waiting for caches to sync for endpoint controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.436916    3373 replication_controller.go:151] Starting RC controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.436957    3373 controller_utils.go:994] Waiting for caches to sync for RC controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.453337    3373 controllermanager.go:439] Started \"namespace\"\r\nMar 20 11:53:20 minikube localkube[3373]: E0320 11:53:20.454906    3373 certificates.go:48] Failed to start certificate controller: error reading CA cert file \"/etc/kubernetes/ca/ca.pem\": open /etc/kubernetes/ca/ca.pem: no such file or directory\r\nMar 20 11:53:20 minikube localkube[3373]: W0320 11:53:20.454929    3373 controllermanager.go:436] Skipping \"csrsigning\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.468062    3373 controllermanager.go:439] Started \"statefulset\"\r\nMar 20 11:53:20 minikube localkube[3373]: W0320 11:53:20.468369    3373 controllermanager.go:423] \"tokencleaner\" is disabled\r\nMar 20 11:53:20 minikube localkube[3373]: W0320 11:53:20.468561    3373 core.go:76] Unsuccessful parsing of cluster CIDR : invalid CIDR address:\r\nMar 20 11:53:20 minikube localkube[3373]: W0320 11:53:20.468675    3373 core.go:80] Unsuccessful parsing of service CIDR : invalid CIDR address:\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.472387    3373 nodecontroller.go:224] Sending events to api server.\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.472925    3373 taint_controller.go:159] Sending events to api server.\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.473207    3373 controllermanager.go:439] Started \"node\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.477135    3373 controllermanager.go:439] Started \"podgc\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.477635    3373 gc_controller.go:76] Starting GC controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.479032    3373 controller_utils.go:994] Waiting for caches to sync for GC controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.479088    3373 controller_utils.go:994] Waiting for caches to sync for namespace controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.479126    3373 stateful_set.go:147] Starting stateful set controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.479134    3373 controller_utils.go:994] Waiting for caches to sync for stateful set controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.480988    3373 nodecontroller.go:481] Starting node controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.481015    3373 controller_utils.go:994] Waiting for caches to sync for node controller\r\nMar 20 11:53:20 minikube localkube[3373]: E0320 11:53:20.481577    3373 util.go:45] Metric for serviceaccount_controller already registered\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.481807    3373 controllermanager.go:439] Started \"serviceaccount\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.487860    3373 serviceaccounts_controller.go:113] Starting service account controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.488190    3373 controller_utils.go:994] Waiting for caches to sync for service account controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.509938    3373 controller_utils.go:1001] Caches are synced for tokens controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.546688    3373 controllermanager.go:439] Started \"garbagecollector\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.548389    3373 controllermanager.go:439] Started \"job\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.549976    3373 controllermanager.go:439] Started \"replicaset\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.551650    3373 controllermanager.go:439] Started \"disruption\"\r\nMar 20 11:53:20 minikube localkube[3373]: E0320 11:53:20.553263    3373 core.go:66] Failed to start service controller: WARNING: no cloud provider provided, services of type LoadBalancer will fail.\r\nMar 20 11:53:20 minikube localkube[3373]: W0320 11:53:20.553458    3373 controllermanager.go:436] Skipping \"service\"\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.554664    3373 garbagecollector.go:123] Starting garbage collector controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.554976    3373 controller_utils.go:994] Waiting for caches to sync for garbage collector controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.555324    3373 jobcontroller.go:133] Starting job controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.555554    3373 controller_utils.go:994] Waiting for caches to sync for job controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.556320    3373 replica_set.go:156] Starting replica set controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.556555    3373 controller_utils.go:994] Waiting for caches to sync for replica set controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.556923    3373 disruption.go:297] Starting disruption controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.557111    3373 controller_utils.go:994] Waiting for caches to sync for disruption controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.646751    3373 controller_utils.go:1001] Caches are synced for certificate controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.680062    3373 controller_utils.go:1001] Caches are synced for job controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.680385    3373 controller_utils.go:1001] Caches are synced for replica set controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.687568    3373 controller_utils.go:1001] Caches are synced for TTL controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.687948    3373 controller_utils.go:1001] Caches are synced for GC controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.688583    3373 controller_utils.go:1001] Caches are synced for namespace controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.688923    3373 controller_utils.go:1001] Caches are synced for stateful set controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.689210    3373 controller_utils.go:1001] Caches are synced for node controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.689658    3373 taint_controller.go:182] Starting NoExecuteTaintManager\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.706142    3373 controller_utils.go:1001] Caches are synced for service account controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.715469    3373 controller_utils.go:1001] Caches are synced for persistent volume controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.716263    3373 controller_utils.go:1001] Caches are synced for resource quota controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.718676    3373 controller_utils.go:1001] Caches are synced for endpoint controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.737569    3373 controller_utils.go:1001] Caches are synced for daemon sets controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.737618    3373 controller_utils.go:1001] Caches are synced for RC controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.737630    3373 controller_utils.go:1001] Caches are synced for HPA controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.737666    3373 controller_utils.go:1001] Caches are synced for attach detach controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.761005    3373 controller_utils.go:1001] Caches are synced for deployment controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.765661    3373 controller_utils.go:1001] Caches are synced for disruption controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.765844    3373 disruption.go:305] Sending events to api server.\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.860162    3373 controller_utils.go:1001] Caches are synced for garbage collector controller\r\nMar 20 11:53:20 minikube localkube[3373]: I0320 11:53:20.861479    3373 garbagecollector.go:132] Garbage collector: all resource monitors have synced. Proceeding to collect garbage\r\nMar 20 11:53:21 minikube localkube[3373]: controller-manager is ready!\r\nMar 20 11:53:21 minikube localkube[3373]: Starting scheduler...\r\nMar 20 11:53:21 minikube localkube[3373]: Waiting for scheduler to be healthy...\r\nMar 20 11:53:21 minikube localkube[3373]: E0320 11:53:21.263873    3373 server.go:164] unable to register configz: register config \"componentconfig\" twice\r\nMar 20 11:53:21 minikube localkube[3373]: I0320 11:53:21.977018    3373 controller_utils.go:994] Waiting for caches to sync for scheduler controller\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.077466    3373 controller_utils.go:1001] Caches are synced for scheduler controller\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.077588    3373 leaderelection.go:179] attempting to acquire leader lease...\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.081296    3373 leaderelection.go:189] successfully acquired lease kube-system/kube-scheduler\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.081614    3373 event.go:218] Event(v1.ObjectReference{Kind:\"Endpoints\", Namespace:\"kube-system\", Name:\"kube-scheduler\", UID:\"49f9d1ee-2c35-11e8-bd95-080027f6dbed\", APIVersion:\"v1\", ResourceVersion:\"82\", FieldPath:\"\"}): type: 'Normal' reason: 'LeaderElection' minikube became leader\r\nMar 20 11:53:22 minikube localkube[3373]: scheduler is ready!\r\nMar 20 11:53:22 minikube localkube[3373]: Starting kubelet...\r\nMar 20 11:53:22 minikube localkube[3373]: Waiting for kubelet to be healthy...\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.264187    3373 feature_gate.go:144] feature gates: map[]\r\nMar 20 11:53:22 minikube localkube[3373]: E0320 11:53:22.264337    3373 server.go:318] unable to register configz: register config \"componentconfig\" twice\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.373095    3373 client.go:72] Connecting to docker on unix:///var/run/docker.sock\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.373572    3373 client.go:92] Start docker client with request timeout=2m0s\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.429208    3373 manager.go:143] cAdvisor running in container: \"/system.slice/localkube.service\"\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.455823    3373 fs.go:117] Filesystem partitions: map[/dev/sda1:{mountpoint:/var/lib/docker/overlay2 major:8 minor:1 fsType:ext4 blockSize:0}]\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.456852    3373 manager.go:198] Machine: {NumCores:2 CpuFrequency:2593994 MemoryCapacity:4143607808 MachineID:7add6924af034eeabfeaa6ad277e1861 SystemUUID:B70218D2-5A14-4094-9487-5A3D365FF238 BootID:cd68b907-5eaa-416c-a57a-489fab70c8fc Filesystems:[{Device:/dev/sda1 DeviceMajor:8 DeviceMinor:1 Capacity:17293533184 Type:vfs Inodes:9732096 HasInodes:true} {Device:rootfs DeviceMajor:0 DeviceMinor:1 Capacity:0 Type:vfs Inodes:0 HasInodes:true}] DiskMap:map[8:0:{Name:sda Major:8 Minor:0 Size:20971520000 Scheduler:cfq}] NetworkDevices:[{Name:eth0 MacAddress:08:00:27:f6:db:ed Speed:1000 Mtu:1500} {Name:eth1 MacAddress:08:00:27:56:04:8a Speed:1000 Mtu:1500} {Name:sit0 MacAddress:00:00:00:00 Speed:0 Mtu:1480}] Topology:[{Id:0 Memory:4143607808 Cores:[{Id:0 Threads:[0] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2} {Size:6291456 Type:Unified Level:3} {Size:134217728 Type:Unified Level:4}]} {Id:1 Threads:[1] Caches:[{Size:32768 Type:Data Level:1} {Size:32768 Type:Instruction Level:1} {Size:262144 Type:Unified Level:2} {Size:6291456 Type:Unified Level:3} {Size:134217728 Type:Unified Level:4}]}] Caches:[]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.460229    3373 manager.go:204] Version: {KernelVersion:4.9.13 ContainerOsVersion:Buildroot 2017.02 DockerVersion:17.06.0-ce DockerAPIVersion:1.30 CadvisorVersion: CadvisorRevision:}\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.460759    3373 server.go:536] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /\r\nMar 20 11:53:22 minikube localkube[3373]: W0320 11:53:22.471112    3373 container_manager_linux.go:218] Running with swap on is not supported, please disable swap! This will be a fatal error by default starting in K8s v1.6! In the meantime, you can opt-in to making this a fatal error by enabling --experimental-fail-swap-on.\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.471187    3373 container_manager_linux.go:246] container manager verified user specified cgroup-root exists: /\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.471254    3373 container_manager_linux.go:251] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>}]} ExperimentalQOSReserved:map[]}\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.471456    3373 kubelet.go:263] Adding manifest file: /etc/kubernetes/manifests\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.471488    3373 kubelet.go:273] Watching apiserver\r\nMar 20 11:53:22 minikube localkube[3373]: W0320 11:53:22.505407    3373 kubelet_network.go:70] Hairpin mode set to \"promiscuous-bridge\" but kubenet is not enabled, falling back to \"hairpin-veth\"\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.505457    3373 kubelet.go:508] Hairpin mode set to \"hairpin-veth\"\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.578564    3373 docker_service.go:208] Docker cri networking managed by kubernetes.io/no-op\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.590774    3373 docker_service.go:225] Setting cgroupDriver to cgroupfs\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.604004    3373 remote_runtime.go:42] Connecting to runtime service unix:///var/run/dockershim.sock\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.605575    3373 kuberuntime_manager.go:166] Container runtime docker initialized, version: 17.06.0-ce, apiVersion: 1.30.0\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.605682    3373 kuberuntime_manager.go:901] updating runtime config through cri with podcidr 10.180.1.0/24\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.605837    3373 docker_service.go:308] docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:10.180.1.0/24,},}\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.605992    3373 kubelet_network.go:326] Setting Pod CIDR:  -> 10.180.1.0/24\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.607095    3373 server.go:943] Started kubelet v1.7.4\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.607480    3373 kubelet_node_status.go:247] Setting node annotation to enable volume controller attach/detach\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.607793    3373 server.go:132] Starting to listen on 0.0.0.0:10250\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.608550    3373 server.go:310] Adding debug handlers to kubelet server.\r\nMar 20 11:53:22 minikube localkube[3373]: E0320 11:53:22.607138    3373 kubelet.go:1229] Image garbage collection failed once. Stats initialization may not have completed yet: unable to find data for container /\r\nMar 20 11:53:22 minikube localkube[3373]: E0320 11:53:22.615705    3373 kubelet.go:1729] Failed to check if disk space is available for the runtime: failed to get fs info for \"runtime\": unable to find data for container /\r\nMar 20 11:53:22 minikube localkube[3373]: E0320 11:53:22.615873    3373 kubelet.go:1737] Failed to check if disk space is available on the root partition: failed to get fs info for \"root\": unable to find data for container /\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.629586    3373 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.630077    3373 status_manager.go:140] Starting to sync pod status with apiserver\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.630173    3373 kubelet.go:1809] Starting kubelet main sync loop.\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.630191    3373 kubelet.go:1820] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]\r\nMar 20 11:53:22 minikube localkube[3373]: E0320 11:53:22.630055    3373 container_manager_linux.go:543] [ContainerManager]: Fail to get rootfs information unable to find data for container /\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.630288    3373 volume_manager.go:245] Starting Kubelet Volume Manager\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.648263    3373 factory.go:351] Registering Docker factory\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.649968    3373 factory.go:89] Registering Rkt factory\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.650185    3373 factory.go:54] Registering systemd factory\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.650784    3373 factory.go:86] Registering Raw factory\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.651531    3373 manager.go:1121] Started watching for new ooms in manager\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.661182    3373 oomparser.go:185] oomparser using systemd\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.662164    3373 manager.go:288] Starting recovery of all containers\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.739652    3373 kubelet_node_status.go:247] Setting node annotation to enable volume controller attach/detach\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.745784    3373 manager.go:293] Recovery completed\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.749228    3373 rkt.go:56] starting detectRktContainers thread\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.765827    3373 kubelet_node_status.go:82] Attempting to register node minikube\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.824366    3373 kubelet_node_status.go:85] Successfully registered node minikube\r\nMar 20 11:53:22 minikube localkube[3373]: E0320 11:53:22.825987    3373 actual_state_of_world.go:500] Failed to set statusUpdateNeeded to needed true because nodeName=\"minikube\"  does not exist\r\nMar 20 11:53:22 minikube localkube[3373]: E0320 11:53:22.826008    3373 actual_state_of_world.go:514] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true because nodeName=\"minikube\"  does not exist\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.858484    3373 kuberuntime_manager.go:901] updating runtime config through cri with podcidr\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.860588    3373 docker_service.go:308] docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:,},}\r\nMar 20 11:53:22 minikube localkube[3373]: I0320 11:53:22.861374    3373 kubelet_network.go:326] Setting Pod CIDR: 10.180.1.0/24 ->\r\nMar 20 11:53:22 minikube localkube[3373]: E0320 11:53:22.864265    3373 helpers.go:771] Could not find capacity information for resource storage.kubernetes.io/scratch\r\nMar 20 11:53:22 minikube localkube[3373]: W0320 11:53:22.864426    3373 helpers.go:782] eviction manager: no observation found for eviction signal allocatableNodeFs.available\r\nMar 20 11:53:23 minikube localkube[3373]: kubelet is ready!\r\nMar 20 11:53:23 minikube localkube[3373]: Starting proxy...\r\nMar 20 11:53:23 minikube localkube[3373]: Waiting for proxy to be healthy...\r\nMar 20 11:53:23 minikube localkube[3373]: E0320 11:53:23.265632    3373 server.go:428] unable to register configz: register config \"componentconfig\" twice\r\nMar 20 11:53:23 minikube localkube[3373]: I0320 11:53:23.296252    3373 server.go:478] Using iptables Proxier.\r\nMar 20 11:53:23 minikube localkube[3373]: W0320 11:53:23.298950    3373 proxier.go:488] clusterCIDR not specified, unable to distinguish between internal and external traffic\r\nMar 20 11:53:23 minikube localkube[3373]: I0320 11:53:23.299222    3373 server.go:513] Tearing down userspace rules.\r\nMar 20 11:53:23 minikube localkube[3373]: E0320 11:53:23.389237    3373 healthcheck.go:302] Failed to start healthz on 0: listen tcp: address 0: missing port in address\r\nMar 20 11:53:23 minikube localkube[3373]: I0320 11:53:23.389786    3373 config.go:202] Starting service config controller\r\nMar 20 11:53:23 minikube localkube[3373]: I0320 11:53:23.392290    3373 controller_utils.go:994] Waiting for caches to sync for service config controller\r\nMar 20 11:53:23 minikube localkube[3373]: I0320 11:53:23.389913    3373 config.go:102] Starting endpoints config controller\r\nMar 20 11:53:23 minikube localkube[3373]: I0320 11:53:23.392316    3373 controller_utils.go:994] Waiting for caches to sync for endpoints config controller\r\nMar 20 11:53:23 minikube localkube[3373]: I0320 11:53:23.492974    3373 controller_utils.go:1001] Caches are synced for endpoints config controller\r\nMar 20 11:53:23 minikube localkube[3373]: I0320 11:53:23.492991    3373 controller_utils.go:1001] Caches are synced for service config controller\r\nMar 20 11:53:24 minikube localkube[3373]: proxy is ready!\r\nMar 20 11:53:24 minikube localkube[3373]: Starting storage-provisioner...\r\nMar 20 11:53:24 minikube localkube[3373]: Waiting for storage-provisioner to be healthy...\r\nMar 20 11:53:24 minikube localkube[3373]: I0320 11:53:24.285213    3373 controller.go:253] Starting provisioner controller 4b48c70b-2c35-11e8-bd95-080027f6dbed!\r\nMar 20 11:53:25 minikube localkube[3373]: storage-provisioner is ready!\r\nMar 20 11:53:25 minikube localkube[3373]: I0320 11:53:25.690096    3373 nodecontroller.go:542] Initializing eviction metric for zone:\r\nMar 20 11:53:25 minikube localkube[3373]: W0320 11:53:25.690432    3373 nodecontroller.go:877] Missing timestamp for Node minikube. Assuming now as a timestamp.\r\nMar 20 11:53:25 minikube localkube[3373]: I0320 11:53:25.690651    3373 nodecontroller.go:793] NodeController detected that zone  is now in state Normal.\r\nMar 20 11:53:25 minikube localkube[3373]: I0320 11:53:25.690434    3373 event.go:218] Event(v1.ObjectReference{Kind:\"Node\", Namespace:\"\", Name:\"minikube\", UID:\"4a636aeb-2c35-11e8-bd95-080027f6dbed\", APIVersion:\"\", ResourceVersion:\"\", FieldPath:\"\"}): type: 'Normal' reason: 'RegisteredNode' Node minikube event: Registered Node minikube in NodeController\r\nMar 20 11:53:27 minikube localkube[3373]: I0320 11:53:27.731979    3373 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume \"addons\" (UniqueName: \"kubernetes.io/host-path/5b0c47ee629af3668fe115f798f73437-addons\") pod \"kube-addon-manager-minikube\" (UID: \"5b0c47ee629af3668fe115f798f73437\")\r\nMar 20 11:53:27 minikube localkube[3373]: I0320 11:53:27.732360    3373 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeconfig\" (UniqueName: \"kubernetes.io/host-path/5b0c47ee629af3668fe115f798f73437-kubeconfig\") pod \"kube-addon-manager-minikube\" (UID: \"5b0c47ee629af3668fe115f798f73437\")\r\nMar 20 11:53:27 minikube localkube[3373]: I0320 11:53:27.942561    3373 kuberuntime_manager.go:457] Container {Name:kube-addon-manager Image:gcr.io/google-containers/kube-addon-manager:v6.4-beta.2 Command:[] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[{Name:KUBECONFIG Value:/var/lib/localkube/kubeconfig ValueFrom:nil}] Resources:{Limits:map[] Requests:map[cpu:{i:{value:5 scale:-3} d:{Dec:<nil>} s:5m Format:DecimalSI} memory:{i:{value:52428800 scale:0} d:{Dec:<nil>} s:50Mi Format:BinarySI}]} VolumeMounts:[{Name:addons ReadOnly:true MountPath:/etc/kubernetes/ SubPath:} {Name:kubeconfig ReadOnly:true MountPath:/var/lib/localkube/ SubPath:}] LivenessProbe:nil ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.\r\nMar 20 12:01:20 minikube localkube[3373]: I0320 12:01:20.345706    3373 event.go:218] Event(v1.ObjectReference{Kind:\"Pod\", Namespace:\"default\", Name:\"busybox\", UID:\"670ac7a7-2c36-11e8-bd95-080027f6dbed\", APIVersion:\"v1\", ResourceVersion:\"630\", FieldPath:\"\"}): type: 'Normal' reason: 'Scheduled' Successfully assigned busybox to minikube\r\nMar 20 12:01:20 minikube localkube[3373]: I0320 12:01:20.367003    3373 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume \"default-token-p1bkn\" (UniqueName: \"kubernetes.io/secret/670ac7a7-2c36-11e8-bd95-080027f6dbed-default-token-p1bkn\") pod \"busybox\" (UID: \"670ac7a7-2c36-11e8-bd95-080027f6dbed\")\r\nMar 20 12:01:20 minikube localkube[3373]: I0320 12:01:20.651235    3373 kuberuntime_manager.go:457] Container {Name:busybox Image:busybox Command:[sleep 3600] Args:[] WorkingDir: Ports:[] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[]} VolumeMounts:[{Name:default-token-p1bkn ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:nil ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.\r\nMar 20 12:02:32 minikube localkube[3373]: E0320 12:02:32.814610    3373 proxy.go:193] Error proxying data from client to backend: write tcp 127.0.0.1:55584->127.0.1.1:10250: write: broken pipe\r\nMar 20 12:03:12 minikube localkube[3373]: store.index: compact 422\r\nMar 20 12:03:12 minikube localkube[3373]: I0320 12:03:12.722434    3373 compact.go:159] etcd: compacted rev (422), endpoints ([http://localhost:2379])\r\nMar 20 12:03:12 minikube localkube[3373]: finished scheduled compaction at 422 (took 814.586µs)\r\nMar 20 12:07:48 minikube localkube[3373]: E0320 12:07:48.718232    3373 watcher.go:210] watch chan error: etcdserver: mvcc: required revision has been compacted\r\nMar 20 12:07:48 minikube localkube[3373]: W0320 12:07:48.718913    3373 reflector.go:323] k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:72: watch of *extensions.ThirdPartyResource ended with: etcdserver: mvcc: required revision has been compacted\r\nMar 20 12:07:53 minikube localkube[3373]: W0320 12:07:53.071302    3373 container.go:352] Failed to create summary reader for \"/system.slice/systemd-tmpfiles-clean.service\": none of the resources are being tracked.\r\nMar 20 12:08:12 minikube localkube[3373]: store.index: compact 763\r\nMar 20 12:08:12 minikube localkube[3373]: I0320 12:08:12.728538    3373 compact.go:159] etcd: compacted rev (763), endpoints ([http://localhost:2379])\r\nMar 20 12:08:12 minikube localkube[3373]: finished scheduled compaction at 763 (took 804.141µs)\r\nMar 20 12:09:27 minikube localkube[3373]: E0320 12:09:27.764278    3373 watcher.go:210] watch chan error: etcdserver: mvcc: required revision has been compacted\r\nMar 20 12:09:27 minikube localkube[3373]: W0320 12:09:27.764545    3373 reflector.go:323] k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/externalversions/factory.go:72: watch of *v1beta1.ThirdPartyResource ended with: etcdserver: mvcc: required revision has been compacted\r\nMar 20 12:13:12 minikube localkube[3373]: store.index: compact 1094\r\nMar 20 12:13:12 minikube localkube[3373]: finished scheduled compaction at 1094 (took 505.587µs)\r\nMar 20 12:13:12 minikube localkube[3373]: I0320 12:13:12.734845    3373 compact.go:159] etcd: compacted rev (1094), endpoints ([http://localhost:2379])\r\nMar 20 12:14:39 minikube localkube[3373]: E0320 12:14:39.944163    3373 proxy.go:207] Error proxying data from backend to client: write tcp 192.168.99.103:8443->192.168.99.1:59197: write: broken pipe\r\nMar 20 12:14:39 minikube localkube[3373]: E0320 12:14:39.944316    3373 proxy.go:193] Error proxying data from client to backend: write tcp 127.0.0.1:55686->127.0.1.1:10250: write: broken pipe\r\nMar 20 12:15:22 minikube localkube[3373]: E0320 12:15:22.772105    3373 watcher.go:210] watch chan error: etcdserver: mvcc: required revision has been compacted\r\nMar 20 12:15:22 minikube localkube[3373]: W0320 12:15:22.772488    3373 reflector.go:323] k8s.io/minikube/vendor/k8s.io/kubernetes/pkg/client/informers/informers_generated/internalversion/factory.go:72: watch of *extensions.ThirdPartyResource ended with: etcdserver: mvcc: required revision has been compacted\r\nMar 20 12:18:12 minikube localkube[3373]: store.index: compact 1423\r\nMar 20 12:18:12 minikube localkube[3373]: I0320 12:18:12.739470    3373 compact.go:159] etcd: compacted rev (1423), endpoints ([http://localhost:2379])\r\nMar 20 12:18:12 minikube localkube[3373]: finished scheduled compaction at 1423 (took 416.331µs)\r\nMar 20 12:19:31 minikube localkube[3373]: I0320 12:19:31.102009    3373 event.go:218] Event(v1.ObjectReference{Kind:\"Deployment\", Namespace:\"kube-system\", Name:\"kube-dns\", UID:\"f12e453a-2c38-11e8-bd95-080027f6dbed\", APIVersion:\"extensions\", ResourceVersion:\"1842\", FieldPath:\"\"}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set kube-dns-1326421443 to 1\r\nMar 20 12:19:31 minikube localkube[3373]: I0320 12:19:31.138294    3373 event.go:218] Event(v1.ObjectReference{Kind:\"ReplicaSet\", Namespace:\"kube-system\", Name:\"kube-dns-1326421443\", UID:\"f12ee3d7-2c38-11e8-bd95-080027f6dbed\", APIVersion:\"extensions\", ResourceVersion:\"1843\", FieldPath:\"\"}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-dns-1326421443-sw3fp\r\nMar 20 12:19:31 minikube localkube[3373]: I0320 12:19:31.160539    3373 event.go:218] Event(v1.ObjectReference{Kind:\"Pod\", Namespace:\"kube-system\", Name:\"kube-dns-1326421443-sw3fp\", UID:\"f13480ee-2c38-11e8-bd95-080027f6dbed\", APIVersion:\"v1\", ResourceVersion:\"1846\", FieldPath:\"\"}): type: 'Normal' reason: 'Scheduled' Successfully assigned kube-dns-1326421443-sw3fp to minikube\r\nMar 20 12:19:31 minikube localkube[3373]: I0320 12:19:31.280327    3373 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-dns-config\" (UniqueName: \"kubernetes.io/configmap/f13480ee-2c38-11e8-bd95-080027f6dbed-kube-dns-config\") pod \"kube-dns-1326421443-sw3fp\" (UID: \"f13480ee-2c38-11e8-bd95-080027f6dbed\")\r\nMar 20 12:19:31 minikube localkube[3373]: I0320 12:19:31.280379    3373 reconciler.go:212] operationExecutor.VerifyControllerAttachedVolume started for volume \"default-token-s1v39\" (UniqueName: \"kubernetes.io/secret/f13480ee-2c38-11e8-bd95-080027f6dbed-default-token-s1v39\") pod \"kube-dns-1326421443-sw3fp\" (UID: \"f13480ee-2c38-11e8-bd95-080027f6dbed\")\r\nMar 20 12:19:31 minikube localkube[3373]: I0320 12:19:31.463035    3373 kuberuntime_manager.go:457] Container {Name:kubedns Image:gcr.io/google_containers/k8s-dns-kube-dns-amd64:1.14.5 Command:[] Args:[--domain=cluster.local. --dns-port=10053 --config-map=kube-dns --v=2] WorkingDir: Ports:[{Name:dns-local HostPort:0 ContainerPort:10053 Protocol:UDP HostIP:} {Name:dns-tcp-local HostPort:0 ContainerPort:10053 Protocol:TCP HostIP:} {Name:metrics HostPort:0 ContainerPort:10055 Protocol:TCP HostIP:}] EnvFrom:[] Env:[{Name:PROMETHEUS_PORT Value:10055 ValueFrom:nil}] Resources:{Limits:map[memory:{i:{value:178257920 scale:0} d:{Dec:<nil>} s:170Mi Format:BinarySI}] Requests:map[cpu:{i:{value:100 scale:-3} d:{Dec:<nil>} s:100m Format:DecimalSI} memory:{i:{value:73400320 scale:0} d:{Dec:<nil>} s:70Mi Format:BinarySI}]} VolumeMounts:[{Name:kube-dns-config ReadOnly:false MountPath:/kube-dns-config SubPath:} {Name:default-token-s1v39 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthcheck/kubedns,Port:10054,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:60,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:5,} ReadinessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/readiness,Port:8081,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:3,} Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.\r\nMar 20 12:19:31 minikube localkube[3373]: I0320 12:19:31.464941    3373 kuberuntime_manager.go:457] Container {Name:dnsmasq Image:gcr.io/google_containers/k8s-dns-dnsmasq-nanny-amd64:1.14.5 Command:[] Args:[-v=2 -logtostderr -configDir=/etc/k8s/dns/dnsmasq-nanny -restartDnsmasq=true -- -k --cache-size=1000 --log-facility=- --server=/cluster.local/127.0.0.1#10053 --server=/in-addr.arpa/127.0.0.1#10053 --server=/ip6.arpa/127.0.0.1#10053] WorkingDir: Ports:[{Name:dns HostPort:0 ContainerPort:53 Protocol:UDP HostIP:} {Name:dns-tcp HostPort:0 ContainerPort:53 Protocol:TCP HostIP:}] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:150 scale:-3} d:{Dec:<nil>} s:150m Format:DecimalSI} memory:{i:{value:20971520 scale:0} d:{Dec:<nil>} s:20Mi Format:BinarySI}]} VolumeMounts:[{Name:kube-dns-config ReadOnly:false MountPath:/etc/k8s/dns/dnsmasq-nanny SubPath:} {Name:default-token-s1v39 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/healthcheck/dnsmasq,Port:10054,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:60,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:5,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.\r\nMar 20 12:19:31 minikube localkube[3373]: I0320 12:19:31.466531    3373 kuberuntime_manager.go:457] Container {Name:sidecar Image:gcr.io/google_containers/k8s-dns-sidecar-amd64:1.14.5 Command:[] Args:[--v=2 --logtostderr --probe=kubedns,127.0.0.1:10053,kubernetes.default.svc.cluster.local.,5,A --probe=dnsmasq,127.0.0.1:53,kubernetes.default.svc.cluster.local.,5,A] WorkingDir: Ports:[{Name:metrics HostPort:0 ContainerPort:10054 Protocol:TCP HostIP:}] EnvFrom:[] Env:[] Resources:{Limits:map[] Requests:map[cpu:{i:{value:10 scale:-3} d:{Dec:<nil>} s:10m Format:DecimalSI} memory:{i:{value:20971520 scale:0} d:{Dec:<nil>} s:20Mi Format:BinarySI}]} VolumeMounts:[{Name:default-token-s1v39 ReadOnly:true MountPath:/var/run/secrets/kubernetes.io/serviceaccount SubPath:}] LivenessProbe:&Probe{Handler:Handler{Exec:nil,HTTPGet:&HTTPGetAction{Path:/metrics,Port:10054,Host:,Scheme:HTTP,HTTPHeaders:[],},TCPSocket:nil,},InitialDelaySeconds:60,TimeoutSeconds:5,PeriodSeconds:10,SuccessThreshold:1,FailureThreshold:5,} ReadinessProbe:nil Lifecycle:nil TerminationMessagePath:/dev/termination-log TerminationMessagePolicy:File ImagePullPolicy:IfNotPresent SecurityContext:nil Stdin:false StdinOnce:false TTY:false} is dead, but RestartPolicy says that we should restart it.\r\nMar 20 12:19:32 minikube localkube[3373]: W0320 12:19:32.014429    3373 kuberuntime_container.go:176] Non-root verification doesn't support non-numeric user (nobody)\r\nMar 20 12:19:39 minikube localkube[3373]: E0320 12:19:39.988988    3373 conntrack.go:42] conntrack returned error: error looking for path of conntrack: exec: \"conntrack\": executable file not found in $PATH\r\nMar 20 12:23:12 minikube localkube[3373]: store.index: compact 1754\r\nMar 20 12:23:12 minikube localkube[3373]: finished scheduled compaction at 1754 (took 566.364µs)\r\nMar 20 12:23:12 minikube localkube[3373]: I0320 12:23:12.744454    3373 compact.go:159] etcd: compacted rev (1754), endpoints ([http://localhost:2379])\r\n```\r\n\r\n**Anything else do we need to know**:\r\n\r\nI'm new to Kubernetes, have I missed something when starting the cluster or configuring minikube? I see other users that has experienced a similiar issue. \r\nhttps://github.com/kubernetes/minikube/issues/2253\r\nhttps://github.com/kubernetes/minikube/issues/2075\r\nhttps://github.com/kubernetes/minikube/issues/1781"},"comment":{"url":"https://api.github.com/repos/kubernetes/minikube/issues/comments/433591825","html_url":"https://github.com/kubernetes/minikube/issues/2619#issuecomment-433591825","issue_url":"https://api.github.com/repos/kubernetes/minikube/issues/2619","id":433591825,"node_id":"MDEyOklzc3VlQ29tbWVudDQzMzU5MTgyNQ==","user":{"login":"fejta-bot","id":30488982,"node_id":"MDQ6VXNlcjMwNDg4OTgy","avatar_url":"https://avatars1.githubusercontent.com/u/30488982?v=4","gravatar_id":"","url":"https://api.github.com/users/fejta-bot","html_url":"https://github.com/fejta-bot","followers_url":"https://api.github.com/users/fejta-bot/followers","following_url":"https://api.github.com/users/fejta-bot/following{/other_user}","gists_url":"https://api.github.com/users/fejta-bot/gists{/gist_id}","starred_url":"https://api.github.com/users/fejta-bot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fejta-bot/subscriptions","organizations_url":"https://api.github.com/users/fejta-bot/orgs","repos_url":"https://api.github.com/users/fejta-bot/repos","events_url":"https://api.github.com/users/fejta-bot/events{/privacy}","received_events_url":"https://api.github.com/users/fejta-bot/received_events","type":"User","site_admin":false},"created_at":"2018-10-27T05:13:07Z","updated_at":"2018-10-27T05:13:07Z","author_association":"NONE","body":"Rotten issues close after 30d of inactivity.\nReopen the issue with `/reopen`.\nMark the issue as fresh with `/remove-lifecycle rotten`.\n\nSend feedback to sig-testing, kubernetes/test-infra and/or [fejta](https://github.com/fejta).\n/close"}}
{"actor":{"display_login":"fejta-bot"}}