{"action":"created","issue":{"url":"https://api.github.com/repos/rancher/rancher/issues/14046","repository_url":"https://api.github.com/repos/rancher/rancher","labels_url":"https://api.github.com/repos/rancher/rancher/issues/14046/labels{/name}","comments_url":"https://api.github.com/repos/rancher/rancher/issues/14046/comments","events_url":"https://api.github.com/repos/rancher/rancher/issues/14046/events","html_url":"https://github.com/rancher/rancher/issues/14046","id":333365353,"node_id":"MDU6SXNzdWUzMzMzNjUzNTM=","number":14046,"title":"Panic in rancher/server:v2.0.2","user":{"login":"leodotcloud","id":19392926,"node_id":"MDQ6VXNlcjE5MzkyOTI2","avatar_url":"https://avatars3.githubusercontent.com/u/19392926?v=4","gravatar_id":"","url":"https://api.github.com/users/leodotcloud","html_url":"https://github.com/leodotcloud","followers_url":"https://api.github.com/users/leodotcloud/followers","following_url":"https://api.github.com/users/leodotcloud/following{/other_user}","gists_url":"https://api.github.com/users/leodotcloud/gists{/gist_id}","starred_url":"https://api.github.com/users/leodotcloud/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/leodotcloud/subscriptions","organizations_url":"https://api.github.com/users/leodotcloud/orgs","repos_url":"https://api.github.com/users/leodotcloud/repos","events_url":"https://api.github.com/users/leodotcloud/events{/privacy}","received_events_url":"https://api.github.com/users/leodotcloud/received_events","type":"User","site_admin":false},"labels":[{"id":145695744,"node_id":"MDU6TGFiZWwxNDU2OTU3NDQ=","url":"https://api.github.com/repos/rancher/rancher/labels/kind/bug","name":"kind/bug","color":"fc2929","default":false},{"id":659821934,"node_id":"MDU6TGFiZWw2NTk4MjE5MzQ=","url":"https://api.github.com/repos/rancher/rancher/labels/version/2.0","name":"version/2.0","color":"e99695","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-06-18T17:29:08Z","updated_at":"2018-06-18T17:37:49Z","closed_at":null,"author_association":"MEMBER","body":"```\r\n2018/06/18 17:28:30 [INFO] Stopping cluster agent forc-ctgpm\r\n2018/06/18 17:28:30 [INFO] Fetching file https://kubernetes-charts-incubator.storage.googleapis.com/fluentd-elasticsearch-0.1.2.tgz\r\n2018/06/18 17:28:30 [INFO] Syncing SecretController Controller Done\r\nE0618 17:28:31.230255       1 generic_controller.go:204] NamespaceController cattle-system recovered from panic \"assignment to entry in nil map\". (err=<nil>) Call stack:\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:72\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:153\r\n/usr/local/go/src/runtime/asm_amd64.s:509\r\n/usr/local/go/src/runtime/panic.go:491\r\n/usr/local/go/src/runtime/hashmap_fast.go:600\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:101\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:71\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:58\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:31\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/types/apis/core/v1/zz_generated_namespace_controller.go:123\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:250\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:190\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:178\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:170\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88\r\n/usr/local/go/src/runtime/asm_amd64.s:2337\r\n2018/06/18 17:28:31 [INFO] Starting cluster agent forc-tlbfh\r\n2018/06/18 17:28:31 [INFO] Fetching file https://kubernetes-charts-incubator.storage.googleapis.com/fluentd-elasticsearch-0.1.1.tgz\r\n2018/06/18 17:28:31 [INFO] Registering project network policy\r\n\r\n\r\n2018/06/18 17:29:19 [INFO] Fetching file https://kubernetes-charts.storage.googleapis.com/prometheus-6.6.2.tgz\r\n2018/06/18 17:29:20 [INFO] Fetching file https://kubernetes-charts.storage.googleapis.com/prometheus-6.6.1.tgz\r\nE0618 17:29:20.126654       1 generic_controller.go:204] NamespaceController cattle-system recovered from panic \"assignment to entry in nil map\". (err=<nil>) Call stack:\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:72\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:153\r\n/usr/local/go/src/runtime/asm_amd64.s:509\r\n/usr/local/go/src/runtime/panic.go:491\r\n/usr/local/go/src/runtime/hashmap_fast.go:600\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:101\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:71\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:58\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:31\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/types/apis/core/v1/zz_generated_namespace_controller.go:123\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:250\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:190\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:178\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:170\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88\r\n/usr/local/go/src/runtime/asm_amd64.s:2337\r\n2018/06/18 17:29:20 [INFO] Fetching file https://kubernetes-charts.storage.googleapis.com/prometheus-6.6.0.tgz\r\n2018/06/18 17:29:20 [INFO] Fetching file https://kubernetes-charts.storage.googleapis.com/prometheus-6.5.2.tgz\r\nE0618 17:29:20.591220       1 generic_controller.go:204] NamespaceController kube-system recovered from panic \"assignment to entry in nil map\". (err=<nil>) Call stack:\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:72\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/runtime/runtime.go:153\r\n/usr/local/go/src/runtime/asm_amd64.s:509\r\n/usr/local/go/src/runtime/panic.go:491\r\n/usr/local/go/src/runtime/hashmap_fast.go:600\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:101\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:71\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:58\r\n/go/src/github.com/rancher/rancher/pkg/controllers/user/nslabels/labels.go:31\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/types/apis/core/v1/zz_generated_namespace_controller.go:123\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:250\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:190\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:178\r\n/go/src/github.com/rancher/rancher/vendor/github.com/rancher/norman/controller/generic_controller.go:170\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\r\n/go/src/github.com/rancher/rancher/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88\r\n/usr/local/go/src/runtime/asm_amd64.s:2337\r\n2018/06/18 17:29:20 [INFO] Fetching file https://kubernetes-charts.storage.googleapis.com/prometheus-6.5.1.tgz\r\n\r\n2018/06/18 17:29:21 [INFO] Fetching file https://kubernetes-charts.storage.googleapis.com/prometheus-6.5.0.tgz\r\n```"},"comment":{"url":"https://api.github.com/repos/rancher/rancher/issues/comments/398135578","html_url":"https://github.com/rancher/rancher/issues/14046#issuecomment-398135578","issue_url":"https://api.github.com/repos/rancher/rancher/issues/14046","id":398135578,"node_id":"MDEyOklzc3VlQ29tbWVudDM5ODEzNTU3OA==","user":{"login":"leodotcloud","id":19392926,"node_id":"MDQ6VXNlcjE5MzkyOTI2","avatar_url":"https://avatars3.githubusercontent.com/u/19392926?v=4","gravatar_id":"","url":"https://api.github.com/users/leodotcloud","html_url":"https://github.com/leodotcloud","followers_url":"https://api.github.com/users/leodotcloud/followers","following_url":"https://api.github.com/users/leodotcloud/following{/other_user}","gists_url":"https://api.github.com/users/leodotcloud/gists{/gist_id}","starred_url":"https://api.github.com/users/leodotcloud/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/leodotcloud/subscriptions","organizations_url":"https://api.github.com/users/leodotcloud/orgs","repos_url":"https://api.github.com/users/leodotcloud/repos","events_url":"https://api.github.com/users/leodotcloud/events{/privacy}","received_events_url":"https://api.github.com/users/leodotcloud/received_events","type":"User","site_admin":false},"created_at":"2018-06-18T17:37:49Z","updated_at":"2018-06-18T17:37:49Z","author_association":"MEMBER","body":"Background and probable steps to repro:\r\n- 3 node HA cluster with actual certificates with a CLB in front.\r\n- Create a project in the \"local\" cluster.\r\n- Create a namespace\r\n- Loadbalancing, created an ingress, CNAME entry.\r\n- Deployed registry from the catalog on \"local\" cluster.\r\n- Updated to the secret created by the \"registry\" app/catalog.\r\n\r\n- The nodes became unresponsive and had to reboot them(it's mostly due to out of memory due to workloads). The cattle/server moved from one host to another.\r\n\r\nCode: https://github.com/rancher/rancher/blob/v2.0.2/pkg/controllers/user/nslabels/labels.go#L101\r\nPing @alena1108 and @kinarashah based on `git blame`"}}
{"actor":{"display_login":"leodotcloud"}}