{"action":"created","issue":{"url":"https://api.github.com/repos/weaveworks/weave/issues/3429","repository_url":"https://api.github.com/repos/weaveworks/weave","labels_url":"https://api.github.com/repos/weaveworks/weave/issues/3429/labels{/name}","comments_url":"https://api.github.com/repos/weaveworks/weave/issues/3429/comments","events_url":"https://api.github.com/repos/weaveworks/weave/issues/3429/events","html_url":"https://github.com/weaveworks/weave/issues/3429","id":371023020,"node_id":"MDU6SXNzdWUzNzEwMjMwMjA=","number":3429,"title":"weave - net pod crashing CrashLoopBackOff","user":{"login":"irfanjs","id":4394061,"node_id":"MDQ6VXNlcjQzOTQwNjE=","avatar_url":"https://avatars2.githubusercontent.com/u/4394061?v=4","gravatar_id":"","url":"https://api.github.com/users/irfanjs","html_url":"https://github.com/irfanjs","followers_url":"https://api.github.com/users/irfanjs/followers","following_url":"https://api.github.com/users/irfanjs/following{/other_user}","gists_url":"https://api.github.com/users/irfanjs/gists{/gist_id}","starred_url":"https://api.github.com/users/irfanjs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/irfanjs/subscriptions","organizations_url":"https://api.github.com/users/irfanjs/orgs","repos_url":"https://api.github.com/users/irfanjs/repos","events_url":"https://api.github.com/users/irfanjs/events{/privacy}","received_events_url":"https://api.github.com/users/irfanjs/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-10-17T11:19:32Z","updated_at":"2018-10-18T05:48:08Z","closed_at":null,"author_association":"NONE","body":"**what is expected :** \r\nweave net pod run into CrashLoopBackOff status on worker node, but should be recovered from that \r\n\r\n**what happened**\r\n```\r\n[root@kube-worker kubernetes]# kubectl logs weave-net-vfmbf -p -c weave -n kube-system\r\nFailed to get peers\r\n[root@kube-worker kubernetes]#\r\n\r\n```\r\n**how to reproduce**\r\n\r\nNA\r\n\r\n**environment details need to know :**\r\n\r\nkubernetes cluster\r\none master , one worker \r\n\r\n```\r\n[root@kube-worker kubernetes]# kubectl version\r\nClient Version: version.Info{Major:\"1\", Minor:\"12\", GitVersion:\"v1.12.1\", GitCommit:\"4ed3216f3ec431b140b1d899130a69fc671678f4\", GitTreeState:\"clean\", BuildDate:\"2018-10-05T16:46:06Z\", GoVersion:\"go1.10.4\", Compiler:\"gc\", Platform:\"linux/amd64\"}\r\nServer Version: version.Info{Major:\"1\", Minor:\"12\", GitVersion:\"v1.12.1\", GitCommit:\"4ed3216f3ec431b140b1d899130a69fc671678f4\", GitTreeState:\"clean\", BuildDate:\"2018-10-05T16:36:14Z\", GoVersion:\"go1.10.4\", Compiler:\"gc\", Platform:\"linux/amd64\"}\r\n[root@kube-worker kubernetes]#\r\n\r\nKubernetes v1.12.1\r\n\r\n[root@kube-worker kubernetes]# kubectl get nodes\r\nNAME          STATUS   ROLES    AGE     VERSION\r\nkube-master   Ready    master   5d10h   v1.12.1\r\nkube-worker   Ready    <none>   41h     v1.12.1\r\n[root@kube-worker kubernetes]#\r\n\r\n[root@kube-worker kubernetes]# kubectl get pods --all-namespaces -o wide\r\nNAMESPACE     NAME                                  READY   STATUS             RESTARTS   AGE     IP             NODE          NOMINATED NODE\r\nkube-system   coredns-576cbf47c7-4n4tj              1/1     Running            5          5d10h   10.32.0.12     kube-master   <none>\r\nkube-system   coredns-576cbf47c7-7gqjg              1/1     Running            6          5d10h   10.32.0.13     kube-master   <none>\r\nkube-system   etcd-kube-master                      1/1     Running            6          5d10h   172.28.128.3   kube-master   <none>\r\nkube-system   kube-apiserver-kube-master            1/1     Running            5          5d10h   172.28.128.3   kube-master   <none>\r\nkube-system   kube-controller-manager-kube-master   1/1     Running            5          5d10h   172.28.128.3   kube-master   <none>\r\nkube-system   kube-proxy-ndbv8                      1/1     Running            5          5d10h   172.28.128.3   kube-master   <none>\r\nkube-system   kube-proxy-rnr8x                      1/1     Running            3          41h     172.28.128.4   kube-worker   <none>\r\nkube-system   kube-scheduler-kube-master            1/1     Running            6          5d10h   172.28.128.3   kube-master   <none>\r\nkube-system   weave-net-5thls                       2/2     Running            15         5d10h   172.28.128.3   kube-master   <none>\r\nkube-system   weave-net-vfmbf                       1/2     CrashLoopBackOff   102        41h     172.28.128.4   kube-worker   <none>\r\n[root@kube-worker kubernetes]#\r\n\r\n[root@kube-worker kubernetes]# uname -a\r\nLinux kube-worker 3.10.0-862.14.4.el7.x86_64 #1 SMP Wed Sep 26 15:12:11 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux\r\n[root@kube-worker kubernetes]#\r\n\r\n[root@kube-worker kubernetes]# docker --version\r\nDocker version 1.13.1, build 8633870/1.13.1\r\n[root@kube-worker kubernetes]#\r\n\r\n\r\n```\r\n\r\n**Logs**\r\n\r\n```\r\n[root@kube-worker kubernetes]# kubectl logs weave-net-vfmbf -p -c weave -n kube-system\r\nFailed to get peers\r\n[root@kube-worker kubernetes]#\r\n\r\n[root@kube-worker kubernetes]# ip route\r\ndefault via 10.0.2.2 dev enp0s3 proto dhcp metric 100\r\n10.0.2.0/24 dev enp0s3 proto kernel scope link src 10.0.2.15 metric 100\r\n172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1\r\n172.28.128.0/24 dev enp0s8 proto kernel scope link src 172.28.128.4 metric 101\r\n[root@kube-worker kubernetes]#\r\n\r\n[root@kube-worker kubernetes]# ip -4 -o addr\r\n1: lo    inet 127.0.0.1/8 scope host lo\\       valid_lft forever preferred_lft forever\r\n2: enp0s3    inet 10.0.2.15/24 brd 10.0.2.255 scope global noprefixroute dynamic enp0s3\\       valid_lft 79282sec preferred_lft 79282sec\r\n3: enp0s8    inet 172.28.128.4/24 brd 172.28.128.255 scope global noprefixroute enp0s8\\       valid_lft forever preferred_lft forever\r\n4: docker0    inet 172.17.0.1/16 scope global docker0\\       valid_lft forever preferred_lft forever\r\n[root@kube-worker kubernetes]#\r\n\r\n\r\n``` \r\n**NOTE :**\r\nboth these nodes are Vagrant nodes using virtualbox as a hypervisor. \r\nmaster node has IP : 172.28.128.3\r\nworker node has IP : 172.28.128.4\r\n \r\n"},"comment":{"url":"https://api.github.com/repos/weaveworks/weave/issues/comments/430883018","html_url":"https://github.com/weaveworks/weave/issues/3429#issuecomment-430883018","issue_url":"https://api.github.com/repos/weaveworks/weave/issues/3429","id":430883018,"node_id":"MDEyOklzc3VlQ29tbWVudDQzMDg4MzAxOA==","user":{"login":"irfanjs","id":4394061,"node_id":"MDQ6VXNlcjQzOTQwNjE=","avatar_url":"https://avatars2.githubusercontent.com/u/4394061?v=4","gravatar_id":"","url":"https://api.github.com/users/irfanjs","html_url":"https://github.com/irfanjs","followers_url":"https://api.github.com/users/irfanjs/followers","following_url":"https://api.github.com/users/irfanjs/following{/other_user}","gists_url":"https://api.github.com/users/irfanjs/gists{/gist_id}","starred_url":"https://api.github.com/users/irfanjs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/irfanjs/subscriptions","organizations_url":"https://api.github.com/users/irfanjs/orgs","repos_url":"https://api.github.com/users/irfanjs/repos","events_url":"https://api.github.com/users/irfanjs/events{/privacy}","received_events_url":"https://api.github.com/users/irfanjs/received_events","type":"User","site_admin":false},"created_at":"2018-10-18T05:48:08Z","updated_at":"2018-10-18T05:48:08Z","author_association":"NONE","body":"can you please help adding route ?\r\non master , getting below : \r\n```\r\n[root@kube-master vagrant]# curl -Ik https://172.28.128.3:6443/api/v1/namespaces/default/events\r\nHTTP/1.1 403 Forbidden\r\nContent-Type: application/json\r\nX-Content-Type-Options: nosniff\r\nDate: Thu, 18 Oct 2018 10:00:48 GMT\r\nContent-Length: 316\r\n\r\n```\r\n\r\non worker getting below : \r\n\r\n`Unable to write event: 'Post https://172.28.128.3:6443/api/v1/namespaces/default/events: dial tcp 172.28.128.3:6443: connect: connection refused' (may retry after sleep)`"}}
{"actor":{"display_login":"irfanjs"}}