{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/23111","repository_url":"https://api.github.com/repos/kubernetes/kubernetes","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/23111/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/23111/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/23111/events","html_url":"https://github.com/kubernetes/kubernetes/issues/23111","id":141552209,"number":23111,"title":"SkyDNS does not work when using it with Kubernetes Docker multinode setup","user":{"login":"deromka","id":729097,"avatar_url":"https://avatars.githubusercontent.com/u/729097?v=3","gravatar_id":"","url":"https://api.github.com/users/deromka","html_url":"https://github.com/deromka","followers_url":"https://api.github.com/users/deromka/followers","following_url":"https://api.github.com/users/deromka/following{/other_user}","gists_url":"https://api.github.com/users/deromka/gists{/gist_id}","starred_url":"https://api.github.com/users/deromka/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/deromka/subscriptions","organizations_url":"https://api.github.com/users/deromka/orgs","repos_url":"https://api.github.com/users/deromka/repos","events_url":"https://api.github.com/users/deromka/events{/privacy}","received_events_url":"https://api.github.com/users/deromka/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/dependency/docker","name":"dependency/docker","color":"fbfa04"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/node","name":"team/node","color":"d2b48c"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2016-03-17T11:13:26Z","updated_at":"2016-03-18T15:37:06Z","closed_at":null,"body":"I'm running kubernetes docker containers on CentOS Linux release 7.2.1511, 3.10.0-327.10.1.el7.x86_64. \r\nI'm using the following script to run the kube-master [link](https://github.com/kubernetes/kubernetes/blob/master/docs/getting-started-guides/docker-multinode/master.sh) \r\nand the following script to run the SkyDNS [link](https://github.com/kubernetes/kubernetes/blob/master/docs/getting-started-guides/docker-multinode/skydns.yaml.in) I'm updating the the places with {{ pillar }} to the actual values as suggested by the tutorial: http://kubernetes.io/docs/getting-started-guides/docker-multinode/deployDNS/\r\n\r\nI'm using kubernetes 1.2.0-alpha.7\r\n\r\nClient Version: version.Info{Major:\"1\", Minor:\"2+\", GitVersion:\"v1.2.0-beta.0\", GitCommit:\"50f7568d7f9b001c90ed75e79d41478afcd64a34\", GitTreeState:\"clean\"}\r\nServer Version: version.Info{Major:\"1\", Minor:\"2+\", GitVersion:\"v1.2.0-alpha.7\", GitCommit:\"c0fd002fbb25d6a6cd8427d28b8ec78379c354a0\", GitTreeState:\"clean\"}\r\n\r\n`\r\n[local@kube-master-1458129646 ~]$ kubectl cluster-info\r\nKubernetes master is running at http://10.57.50.181:8080\r\nKubeDNS is running at http://10.57.50.181:8080/api/v1/proxy/namespaces/kube-system/services/kube-dns\r\n`\r\nWhen accessing the following URL: [http://10.57.50.181:8080/api/v1/proxy/namespaces/kube-system/services/kube-dns](http://10.57.50.181:8080/api/v1/proxy/namespaces/kube-system/services/kube-dns) I get the following:\r\n\r\n`\r\n{\r\n  \"kind\": \"Status\",\r\n  \"apiVersion\": \"v1\",\r\n  \"metadata\": {},\r\n  \"status\": \"Failure\",\r\n  \"message\": \"no endpoints available for service \\\"kube-dns\\\"\",\r\n  \"reason\": \"ServiceUnavailable\",\r\n  \"code\": 503\r\n}\r\n`\r\n\r\n`[local@kube-master-1458129646 ~]$ kubectl describe svc\r\nName:\t\t\tkubernetes\r\nNamespace:\t\tdefault\r\nLabels:\t\t\tcomponent=apiserver,provider=kubernetes\r\nSelector:\t\t<none>\r\nType:\t\t\tClusterIP\r\nIP:\t\t\t10.0.0.1\r\nPort:\t\t\thttps\t443/TCP\r\nEndpoints:\t\t10.57.50.181:6443\r\nSession Affinity:\tNone\r\nNo events.\r\n`\r\n\r\n`\r\n[local@kube-master-1458129646 ~]$ kubectl describe svc --namespace=kube-system\r\nName:\t\t\tkube-dns\r\nNamespace:\t\tkube-system\r\nLabels:\t\t\tk8s-app=kube-dns,kubernetes.io/cluster-service=true,kubernetes.io/name=KubeDNS\r\nSelector:\t\tk8s-app=kube-dns\r\nType:\t\t\tClusterIP\r\nIP:\t\t\t10.0.0.10\r\nPort:\t\t\tdns\t53/UDP\r\nEndpoints:\t\t\r\nPort:\t\t\tdns-tcp\t53/TCP\r\nEndpoints:\t\t\r\nSession Affinity:\tNone\r\nNo events.\r\n`\r\n\r\nHere are the logs:\r\n\r\n**kube2sky logs**\r\n\r\n`I0317 10:58:02.475909       1 kube2sky.go:462] Etcd server found: http://127.0.0.1:4001\r\nI0317 10:58:03.478586       1 kube2sky.go:529] Using https://10.0.0.1:443 for kubernetes master\r\nI0317 10:58:03.478612       1 kube2sky.go:530] Using kubernetes API <nil>\r\nI0317 10:58:03.479278       1 kube2sky.go:598] Waiting for service: default/kubernetes\r\nI0317 10:58:04.480549       1 kube2sky.go:604] Ignoring error while waiting for service default/kubernetes: Get https://10.0.0.1:443/api/v1/namespaces/default/services/kubernetes: dial tcp 10.0.0.1:443: getsockopt: no route to host. Sleeping 1s before retrying.\r\nI0317 10:58:06.484404       1 kube2sky.go:604] Ignoring error while waiting for service default/kubernetes: Get https://10.0.0.1:443/api/v1/namespaces/default/services/kubernetes: dial tcp 10.0.0.1:443: getsockopt: no route to host. Sleeping 1s before retrying.\r\nI0317 10:58:08.488550       1 kube2sky.go:604] Ignoring error while waiting for service default/kubernetes: Get https://10.0.0.1:443/api/v1/namespaces/default/services/kubernetes: dial tcp 10.0.0.1:443: getsockopt: no route to host. Sleeping 1s before retrying.\r\n`\r\n\r\n**skydns logs**\r\n\r\n`\r\n2016/03/17 09:39:55 skydns: falling back to default configuration, could not read from etcd: 100: Key not found (/skydns) [3]\r\n2016/03/17 09:39:55 skydns: ready for queries on cluster.local. for tcp://0.0.0.0:53 [rcache 0]\r\n2016/03/17 09:39:55 skydns: ready for queries on cluster.local. for udp://0.0.0.0:53 [rcache 0]\r\n2016/03/17 09:40:17 skydns: failure to forward request \"read udp 10.56.190.1:53: no route to host\"\r\n2016/03/17 09:40:20 skydns: failure to forward request \"read udp 10.56.190.1:53: i/o timeout\"\r\n2016/03/17 09:40:27 skydns: failure to forward request \"read udp 10.56.190.1:53: i/o timeout\"\r\n2016/03/17 09:40:31 skydns: failure to forward request \"read udp 10.56.190.1:53: i/o timeout\"\r\n2016/03/17 09:40:38 skydns: failure to forward request \"read udp 10.56.190.1:53: i/o timeout\"\r\n2016/03/17 09:40:42 skydns: failure to forward request \"read udp 10.56.190.1:53: i/o timeout\"\r\n2016/03/17 09:40:49 skydns: failure to forward request \"read udp 10.56.190.1:53: i/o timeout\"\r\n`\r\n\r\n**etcd logs**\r\n`\r\n2016-03-17 09:39:52.074261 I | etcdmain: etcd Version: 2.2.1\r\n2016-03-17 09:39:52.074324 I | etcdmain: Git SHA: 75f8282\r\n2016-03-17 09:39:52.074335 I | etcdmain: Go Version: go1.5.1\r\n2016-03-17 09:39:52.074343 I | etcdmain: Go OS/Arch: linux/amd64\r\n2016-03-17 09:39:52.074384 I | etcdmain: setting maximum number of CPUs to 8, total number of available CPUs is 8\r\n2016-03-17 09:39:52.074974 I | etcdmain: listening for peers on http://localhost:2380\r\n2016-03-17 09:39:52.075239 I | etcdmain: listening for peers on http://localhost:7001\r\n2016-03-17 09:39:52.075304 I | etcdmain: listening for client requests on http://127.0.0.1:2379\r\n2016-03-17 09:39:52.075406 I | etcdmain: listening for client requests on http://127.0.0.1:4001\r\n2016-03-17 09:39:52.075813 I | etcdserver: name = default\r\n2016-03-17 09:39:52.075829 I | etcdserver: data dir = /var/etcd/data\r\n2016-03-17 09:39:52.075837 I | etcdserver: member dir = /var/etcd/data/member\r\n2016-03-17 09:39:52.075844 I | etcdserver: heartbeat = 100ms\r\n2016-03-17 09:39:52.075851 I | etcdserver: election = 1000ms\r\n2016-03-17 09:39:52.075857 I | etcdserver: snapshot count = 10000\r\n2016-03-17 09:39:52.075874 I | etcdserver: advertise client URLs = http://127.0.0.1:2379,http://127.0.0.1:4001\r\n2016-03-17 09:39:52.075887 I | etcdserver: initial advertise peer URLs = http://localhost:2380,http://localhost:7001\r\n2016-03-17 09:39:52.075906 I | etcdserver: initial cluster = default=http://localhost:2380,default=http://localhost:7001\r\n2016-03-17 09:39:52.077919 I | etcdserver: starting member 6a5871dbdd12c17c in cluster f68652439e3f8f2a\r\n2016-03-17 09:39:52.077997 I | raft: 6a5871dbdd12c17c became follower at term 0\r\n2016-03-17 09:39:52.078027 I | raft: newRaft 6a5871dbdd12c17c [peers: [], term: 0, commit: 0, applied: 0, lastindex: 0, lastterm: 0]\r\n2016-03-17 09:39:52.078036 I | raft: 6a5871dbdd12c17c became follower at term 1\r\n2016-03-17 09:39:52.078279 I | etcdserver: starting server... [version: 2.2.1, cluster version: to_be_decided]\r\n2016-03-17 09:39:52.079411 N | etcdserver: added local member 6a5871dbdd12c17c [http://localhost:2380 http://localhost:7001] to cluster f68652439e3f8f2a\r\n2016-03-17 09:39:52.878477 I | raft: 6a5871dbdd12c17c is starting a new election at term 1\r\n2016-03-17 09:39:52.878553 I | raft: 6a5871dbdd12c17c became candidate at term 2\r\n2016-03-17 09:39:52.878574 I | raft: 6a5871dbdd12c17c received vote from 6a5871dbdd12c17c at term 2\r\n2016-03-17 09:39:52.878600 I | raft: 6a5871dbdd12c17c became leader at term 2\r\n2016-03-17 09:39:52.878666 I | raft: raft.node: 6a5871dbdd12c17c elected leader 6a5871dbdd12c17c at term 2\r\n2016-03-17 09:39:52.879294 I | etcdserver: setting up the initial cluster version to 2.2\r\n2016-03-17 09:39:52.879432 I | etcdserver: published {Name:default ClientURLs:[http://127.0.0.1:2379 http://127.0.0.1:4001]} to cluster f68652439e3f8f2a\r\n2016-03-17 09:39:52.880946 N | etcdserver: set the initial cluster version to 2.2\r\n2016-03-17 11:03:10.579853 I | etcdserver: start to snapshot (applied: 10001, lastsnap: 0)\r\n2016-03-17 11:03:10.582194 I | etcdserver: saved snapshot at index 10001\r\n2016-03-17 11:03:10.582470 I | etcdserver: compacted raft log at 5001\r\n`\r\n\r\nI have exactly followed the tutorial: [docker multinode setup](http://kubernetes.io/docs/getting-started-guides/docker-multinode/), but I cannot make the SkyDNS work\r\n\r\nWhat am I missing? Or it is a bug in the scritps?"},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/198412865","html_url":"https://github.com/kubernetes/kubernetes/issues/23111#issuecomment-198412865","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/23111","id":198412865,"user":{"login":"bprashanth","id":10927820,"avatar_url":"https://avatars.githubusercontent.com/u/10927820?v=3","gravatar_id":"","url":"https://api.github.com/users/bprashanth","html_url":"https://github.com/bprashanth","followers_url":"https://api.github.com/users/bprashanth/followers","following_url":"https://api.github.com/users/bprashanth/following{/other_user}","gists_url":"https://api.github.com/users/bprashanth/gists{/gist_id}","starred_url":"https://api.github.com/users/bprashanth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bprashanth/subscriptions","organizations_url":"https://api.github.com/users/bprashanth/orgs","repos_url":"https://api.github.com/users/bprashanth/repos","events_url":"https://api.github.com/users/bprashanth/events{/privacy}","received_events_url":"https://api.github.com/users/bprashanth/received_events","type":"User","site_admin":false},"created_at":"2016-03-18T15:37:06Z","updated_at":"2016-03-18T15:37:06Z","body":"go team ansible scripts!\r\nI think @mikedanese is making cluster bootstrap scripts more robust in general"}}