{"action":"created","issue":{"url":"https://api.github.com/repos/zalando-incubator/postgres-operator/issues/393","repository_url":"https://api.github.com/repos/zalando-incubator/postgres-operator","labels_url":"https://api.github.com/repos/zalando-incubator/postgres-operator/issues/393/labels{/name}","comments_url":"https://api.github.com/repos/zalando-incubator/postgres-operator/issues/393/comments","events_url":"https://api.github.com/repos/zalando-incubator/postgres-operator/issues/393/events","html_url":"https://github.com/zalando-incubator/postgres-operator/issues/393","id":362616385,"node_id":"MDU6SXNzdWUzNjI2MTYzODU=","number":393,"title":"Load Balancer for PG master never ready, missing selectors; load balancer for PG replica servers is never created","user":{"login":"philippfreyer","id":29856235,"node_id":"MDQ6VXNlcjI5ODU2MjM1","avatar_url":"https://avatars1.githubusercontent.com/u/29856235?v=4","gravatar_id":"","url":"https://api.github.com/users/philippfreyer","html_url":"https://github.com/philippfreyer","followers_url":"https://api.github.com/users/philippfreyer/followers","following_url":"https://api.github.com/users/philippfreyer/following{/other_user}","gists_url":"https://api.github.com/users/philippfreyer/gists{/gist_id}","starred_url":"https://api.github.com/users/philippfreyer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/philippfreyer/subscriptions","organizations_url":"https://api.github.com/users/philippfreyer/orgs","repos_url":"https://api.github.com/users/philippfreyer/repos","events_url":"https://api.github.com/users/philippfreyer/events{/privacy}","received_events_url":"https://api.github.com/users/philippfreyer/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-09-21T13:28:02Z","updated_at":"2018-09-21T13:46:51Z","closed_at":null,"author_association":"NONE","body":"### Disclaimer\r\nI am aware of issue #340. However, this ticket seems to be on hold and I also face the issue of the replica service never being created. I will already provide the details asked for in ticket #340, since this may help moving this along.\r\n\r\n### Problem\r\nWhen I deploy a new cluster using the operator, the cluster starts up fine and the nodes get the seemingly correct splio roles. The master load balancer service is being created and has an added endpoint (pointing to the master node),but the service never actively references a pod unless I copy the values from the metadata.labels section into a selector. With or without the selector, the kubernetes load balancer service is never being displayed as \"Ready\", which in my eyes may be the problem causing the next issue:\r\nA replica load balancer service is never created.\r\n\r\nI need both services in order to be able to add pgpool-II into my deployment for load balancing.\r\n\r\n### Versions Use*\r\nI am using the operator to deploy a Postgres cluster on our bare-metal Kubernetes 1.11 cluster. The issues have already been observed when I started trying out postgres-operator with Kubernetes 1.10, though.\r\n\r\n### Relevant files\r\nPlease ask, if I should provide more. Variables writen in capitals are replaced by my deployment shell script before the file is applied using `kubectl`:\r\n**configmap**\r\n```apiVersion: v1\r\nkind: ConfigMap\r\nmetadata:\r\n  name: postgres-operator\r\n  namespace: NAMESPACE\r\ndata:\r\n  # the env var with the same name in the operator pod may overwrite this value\r\n  # if neither is set or evaluates to the empty string, listen to the operator's own namespace\r\n  # if set to the \"*\", listen to all namespaces\r\n  watched_namespace: NAMESPACE\r\n  service_account_name: zalando-pg-operator-NAMESPACE\r\n  cluster_labels: application:spilo\r\n  cluster_name_label: version\r\n  pod_role_label: spilo-role\r\n  db_hosted_zone: NAMESPACE\r\n  debug_logging: \"true\"\r\n  master_dns_name_format: '{cluster}.{hostedzone}'\r\n  replica_dns_name_format: '{cluster}-repl.{hostedzone}'\r\n  docker_image: registry.opensource.zalan.do/acid/demospilo-10:1.3-p3\r\n  secret_name_template: '{username}.{cluster}.credentials'\r\n  etcd_host: \"\"\r\n  infrastructure_roles_secret_name: postgresql-infrastructure-roles\r\n  oauth_token_secret_name: postgresql-operator\r\n  pam_configuration: |\r\n    https://info.example.com/oauth2/tokeninfo?access_token= uid realm=/employees\r\n  pam_role_name: zalandos\r\n  pod_deletion_wait_timeout: 10m\r\n  pod_label_wait_timeout: 10m\r\n  ready_wait_interval: 3s\r\n  ready_wait_timeout: 30s\r\n  replication_username: standby\r\n  resource_check_interval: 3s\r\n  resource_check_timeout: 10m\r\n  resync_period: 5m\r\n  super_username: postgres\r\n  enable_teams_api: \"false\"\r\n  enable_team_superuser: \"false\"\r\n  team_admin_role: \"admin\"\r\n  teams_api_url: http://fake-teams-api.default.svc.cluster.local\r\n  workers: \"5\"\r\n  # turn on/off load balancers for all Postgres clusters managed by the operator\r\n  # LB settings in cluster manifests take priority over these settings\r\n  enable_master_load_balancer: \"true\"\r\n  enable_replica_load_balancer: \"true\"\r\n  api_port: \"8080\"\r\n  ring_log_lines: \"100\"\r\n  cluster_history_entries: \"1000\"\r\n  pod_terminate_grace_period: 5m\r\n  pdb_name_format: \"postgres-{cluster}-pdb\"\r\n  node_eol_label: \"lifecycle-status:pending-decommission\"\r\n  node_readiness_label: \"\"\r\n  team_api_role_configuration: \"log_statement:all\"\r\n```\r\n\r\n**rbac**\r\n```\r\napiVersion: v1\r\nkind: ServiceAccount\r\nmetadata:\r\n  name: zalando-pg-operator-NAMESPACE\r\n  namespace: NAMESPACE\r\n\r\n---\r\napiVersion: rbac.authorization.k8s.io/v1beta1\r\nkind: ClusterRole\r\nmetadata:\r\n  name: zalando-pg-operator-NAMESPACE\r\nrules:\r\n- apiGroups:\r\n  - acid.zalan.do\r\n  resources:\r\n  - postgresqls\r\n  verbs:\r\n  - \"*\"\r\n- apiGroups:\r\n  - apiextensions.k8s.io\r\n  resources:\r\n  - customresourcedefinitions\r\n  verbs:\r\n  - create\r\n  - get\r\n- apiGroups:\r\n  - \"\"\r\n  resources:\r\n  - configmaps\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n- apiGroups:\r\n  - \"\"\r\n  resources:\r\n  - endpoints\r\n  verbs:\r\n  - create\r\n  - delete\r\n  - get\r\n  - list\r\n  - watch\r\n  - update\r\n  - patch\r\n- apiGroups:\r\n  - \"\"\r\n  resources:\r\n  - secrets\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n- apiGroups:\r\n  - \"\"\r\n  resources:\r\n  - nodes\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n- apiGroups:\r\n  - \"\"\r\n  resources:\r\n  - persistentvolumeclaims\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n- apiGroups:\r\n  - \"\"\r\n  resources:\r\n  - persistentvolumes\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n- apiGroups:\r\n  - \"\"\r\n  resources:\r\n  - pods\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n- apiGroups:\r\n  - \"\"\r\n  resources:\r\n  - services\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n- apiGroups:\r\n  - apps\r\n  resources:\r\n  - statefulsets\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n- apiGroups:\r\n  - \"\"\r\n  resources:\r\n  - namespaces\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n- apiGroups:\r\n  - policy\r\n  resources:\r\n  - poddisruptionbudgets\r\n  verbs:\r\n  - get\r\n  - list\r\n  - create\r\n  - watch\r\n  - patch\r\n  - update\r\n  - delete\r\n\r\n---\r\napiVersion: rbac.authorization.k8s.io/v1\r\nkind: ClusterRoleBinding\r\nmetadata:\r\n  name: zalando-pg-operator-NAMESPACE\r\nroleRef:\r\n  apiGroup: rbac.authorization.k8s.io\r\n  kind: ClusterRole\r\n  name: zalando-pg-operator-NAMESPACE\r\nsubjects:\r\n- kind: ServiceAccount\r\n# note: the cluster role binding needs to be defined\r\n# for every namespace the operator service account lives in.\r\n  name: zalando-pg-operator-NAMESPACE\r\n  namespace: default\r\n- kind: ServiceAccount\r\n  name: zalando-pg-operator-NAMESPACE\r\n  namespace: NAMESPACE\r\n```\r\n**cluster manifest**\r\n```\r\napiVersion: \"acid.zalan.do/v1\"\r\nkind: postgresql\r\nmetadata:\r\n  name: PGDBCLEAN-postgres-NAMESPACE-cluster\r\n  namespace: NAMESPACE\r\nspec:\r\n  teamId: \"PGDBCLEAN\"\r\n  enableMasterLoadBalancer: true\r\n  enableReplicaLoadBalancer: true\r\n  volume:\r\n    size: SIZEGi\r\n    storageClass: \"normal\"\r\n  numberOfInstances: REPLICAS\r\n  users:\r\n    # database owner\r\n    POSTGRES_USER:\r\n    - superuser\r\n    - createdb\r\n\r\n  #databases: name->owner\r\n  databases:\r\n    POSTGRES_DB: POSTGRES_USER\r\n  postgresql:\r\n    version: \"10\"\r\n    parameters:\r\n      shared_buffers: \"500MB\"\r\n      max_connections: \"2048\"\r\n```\r\n**postgres-operator**\r\n```\r\napiVersion: apps/v1beta1\r\nkind: Deployment\r\nmetadata:\r\n  name: postgres-operator\r\n  namespace: NAMESPACE\r\nspec:\r\n  replicas: 1\r\n  template:\r\n    metadata:\r\n      labels:\r\n        name: postgres-operator\r\n    spec:\r\n      serviceAccountName: zalando-pg-operator-NAMESPACE\r\n      containers:\r\n      - name: postgres-operator\r\n        image: registry.opensource.zalan.do/acid/postgres-operator:0f392c2\r\n        imagePullPolicy: IfNotPresent\r\n        env:\r\n        # uncomment to overwrite a similar setting from operator configmap\r\n        # if set to the empty string, watch the operator's own namespace\r\n        # if set to the \"*\", listen to all namespaces\r\n        # - name: WATCHED_NAMESPACE\r\n        #  valueFrom:\r\n        #    fieldRef:\r\n        #      fieldPath: metadata.namespace\r\n        - name: CONFIG_MAP_NAME\r\n          value: \"postgres-operator\"\r\n```\r\n** kubectl get pods -l version=acid-thingworx-cluster -L spilo-role -o wide**\r\n```\r\nNAME                                READY     STATUS    RESTARTS   AGE       IP                NODE       SPILO-ROLE\r\nomg-postgres-NAMESPACE-cluster-0   1/1       Running   0          30m       192.168.255.48    k8s00004   master\r\nomg-postgres-NAMESPACE-cluster-1   1/1       Running   0          30m       192.168.54.41     k8s00002   replica\r\nomg-postgres-NAMESPACE-cluster-2   1/1       Running   0          30m       192.168.100.251   k8s00010   replica\r\nomg-postgres-NAMESPACE-cluster-3   1/1       Running   0          30m       192.168.205.242   k8s00012   replica\r\nomg-postgres-NAMESPACE-cluster-4   1/1       Running   0          30m       192.168.10.190    k8s00011   replica\r\n```\r\n** kubectl get ep -l version=acid-thingworx-cluster **\r\n```\r\nNAME                              ENDPOINTS             AGE\r\nomg-postgres-NAMESPACE-cluster   192.168.255.48:5432   33m\r\n```\r\n\r\n** kubectl get ep acid-thingworx-cluster -o yaml **\r\n```\r\napiVersion: v1\r\nkind: Endpoints\r\nmetadata:\r\n  creationTimestamp: 2018-09-21T12:50:11Z\r\n  labels:\r\n    application: spilo\r\n    spilo-role: master\r\n    version: omg-postgres-NAMESPACE-cluster\r\n  name: omg-postgres-NAMESPACE-cluster\r\n  namespace: NAMESPACE\r\n  resourceVersion: \"12193533\"\r\n  selfLink: /api/v1/namespaces/NAMESPACE/endpoints/omg-postgres-NAMESPACE-cluster\r\n  uid: e0d4b30c-bd9c-11e8-a89f-3085a93fc1bb\r\nsubsets:\r\n- addresses:\r\n  - hostname: omg-postgres-NAMESPACE-cluster-0\r\n    ip: 192.168.255.48\r\n    nodeName: k8s00004\r\n    targetRef:\r\n      kind: Pod\r\n      name: omg-postgres-NAMESPACE-cluster-0\r\n      namespace: NAMESPACE\r\n      resourceVersion: \"12186981\"\r\n      uid: e1117681-bd9c-11e8-a89f-3085a93fc1bb\r\n  ports:\r\n  - name: postgresql\r\n    port: 5432\r\n    protocol: TCP\r\n```\r\n** postgres-operator log **\r\n```\r\n2018/09/21 12:48:43 Spilo operator 0f392c2\r\n2018/09/21 12:48:43 Fully qualified configmap name: NAMESPACE/postgres-operator\r\ntime=\"2018-09-21T12:48:43Z\" level=info msg=\"Listenting to the specific namespace \\\"NAMESPACE\\\"\" pkg=controller\r\ntime=\"2018-09-21T12:48:43Z\" level=info msg=\"config: {\\n\\t\\\"ReadyWaitInterval\\\": 3000000000,\\n\\t\\\"ReadyWaitTimeout\\\": 30000000000,\\n\\t\\\"ResyncPeriod\\\": 300000000000,\\n\\t\\\"ResourceCheckInterval\\\": 3000000000,\\n\\t\\\"ResourceCheckTimeout\\\": 600000000000,\\n\\t\\\"PodLabelWaitTimeout\\\": 600000000000,\\n\\t\\\"PodDeletionWaitTimeout\\\": 600000000000,\\n\\t\\\"ClusterLabels\\\": {\\n\\t\\t\\\"application\\\": \\\"spilo\\\"\\n\\t},\\n\\t\\\"ClusterNameLabel\\\": \\\"version\\\",\\n\\t\\\"PodRoleLabel\\\": \\\"spilo-role\\\",\\n\\t\\\"PodToleration\\\": null,\\n\\t\\\"DefaultCPURequest\\\": \\\"100m\\\",\\n\\t\\\"DefaultMemoryRequest\\\": \\\"100Mi\\\",\\n\\t\\\"DefaultCPULimit\\\": \\\"3\\\",\\n\\t\\\"DefaultMemoryLimit\\\": \\\"1Gi\\\",\\n\\t\\\"PodEnvironmentConfigMap\\\": \\\"\\\",\\n\\t\\\"NodeReadinessLabel\\\": null,\\n\\t\\\"MaxInstances\\\": -1,\\n\\t\\\"MinInstances\\\": -1,\\n\\t\\\"SecretNameTemplate\\\": \\\"{username}.{cluster}.credentials\\\",\\n\\t\\\"PamRoleName\\\": \\\"zalandos\\\",\\n\\t\\\"PamConfiguration\\\": \\\"https://info.example.com/oauth2/tokeninfo?access_token= uid realm=/employees\\\\n\\\",\\n\\t\\\"TeamsAPIUrl\\\": \\\"http://fake-teams-api.default.svc.cluster.local\\\",\\n\\t\\\"OAuthTokenSecretName\\\": \\\"NAMESPACE/postgresql-operator\\\",\\n\\t\\\"InfrastructureRolesSecretName\\\": \\\"NAMESPACE/postgresql-infrastructure-roles\\\",\\n\\t\\\"SuperUsername\\\": \\\"postgres\\\",\\n\\t\\\"ReplicationUsername\\\": \\\"standby\\\",\\n\\t\\\"ScalyrAPIKey\\\": \\\"\\\",\\n\\t\\\"ScalyrImage\\\": \\\"\\\",\\n\\t\\\"ScalyrServerURL\\\": \\\"https://upload.eu.scalyr.com\\\",\\n\\t\\\"ScalyrCPURequest\\\": \\\"100m\\\",\\n\\t\\\"ScalyrMemoryRequest\\\": \\\"50Mi\\\",\\n\\t\\\"ScalyrCPULimit\\\": \\\"1\\\",\\n\\t\\\"ScalyrMemoryLimit\\\": \\\"1Gi\\\",\\n\\t\\\"WatchedNamespace\\\": \\\"NAMESPACE\\\",\\n\\t\\\"EtcdHost\\\": \\\"\\\",\\n\\t\\\"DockerImage\\\": \\\"registry.opensource.zalan.do/acid/demospilo-10:1.3-p3\\\",\\n\\t\\\"ServiceAccountName\\\": \\\"zalando-pg-operator-NAMESPACE\\\",\\n\\t\\\"DbHostedZone\\\": \\\"NAMESPACE\\\",\\n\\t\\\"EtcdScope\\\": \\\"service\\\",\\n\\t\\\"WALES3Bucket\\\": \\\"\\\",\\n\\t\\\"KubeIAMRole\\\": \\\"\\\",\\n\\t\\\"DebugLogging\\\": true,\\n\\t\\\"EnableDBAccess\\\": true,\\n\\t\\\"EnableTeamsAPI\\\": false,\\n\\t\\\"EnableTeamSuperuser\\\": false,\\n\\t\\\"TeamAdminRole\\\": \\\"admin\\\",\\n\\t\\\"EnableLoadBalancer\\\": true,\\n\\t\\\"MasterDNSNameFormat\\\": \\\"{cluster}.{hostedzone}\\\",\\n\\t\\\"ReplicaDNSNameFormat\\\": \\\"{cluster}-repl.{hostedzone}\\\",\\n\\t\\\"PDBNameFormat\\\": \\\"postgres-{cluster}-pdb\\\",\\n\\t\\\"Workers\\\": 5,\\n\\t\\\"APIPort\\\": 8080,\\n\\t\\\"RingLogLines\\\": 100,\\n\\t\\\"ClusterHistoryEntries\\\": 1000,\\n\\t\\\"TeamAPIRoleConfiguration\\\": {\\n\\t\\t\\\"log_statement\\\": \\\"all\\\"\\n\\t},\\n\\t\\\"PodTerminateGracePeriod\\\": 300000000000,\\n\\t\\\"ProtectedRoles\\\": [\\n\\t\\t\\\"admin\\\"\\n\\t]\\n}\" pkg=controller\r\ntime=\"2018-09-21T12:48:43Z\" level=info msg=\"customResourceDefinition \\\"postgresqls.acid.zalan.do\\\" is already registered\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"infrastructure roles secret name: \\\"NAMESPACE/postgresql-infrastructure-roles\\\"\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=warning msg=\"could not get infrastructure roles: could not get infrastructure roles secret: secrets \\\"postgresql-infrastructure-roles\\\" not found\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=info msg=\"started working in background\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=info msg=\"listening on :8080\" pkg=apiserver\r\ntime=\"2018-09-21T12:48:46Z\" level=info msg=\"no clusters running\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/str00004\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00010\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00005\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/str00002\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/str00003\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00008\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00002\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00003\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00001\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00011\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00007\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00009\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00012\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00004\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:48:46Z\" level=debug msg=\"new node has been added: \\\"/k8s00006\\\" ()\" pkg=controller\r\ntime=\"2018-09-21T12:50:11Z\" level=info msg=\"\\\"ADD\\\" event has been queued\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=controller worker=0\r\ntime=\"2018-09-21T12:50:11Z\" level=info msg=\"creation of the cluster started\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=controller worker=0\r\ntime=\"2018-09-21T12:50:11Z\" level=info msg=\"endpoint \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster\\\" has been successfully created\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=info msg=\"master service \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster\\\" has been successfully created\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=debug msg=\"team API is disabled, returning empty list of members\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=info msg=\"users have been initialized\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=debug msg=\"created new secret \\\"NAMESPACE/okmapgo.omg-postgres-NAMESPACE-cluster.credentials\\\", uid: \\\"e0ea5de3-bd9c-11e8-a89f-3085a93fc1bb\\\"\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=debug msg=\"created new secret \\\"NAMESPACE/postgres.omg-postgres-NAMESPACE-cluster.credentials\\\", uid: \\\"e0ecc0e0-bd9c-11e8-a89f-3085a93fc1bb\\\"\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=debug msg=\"created new secret \\\"NAMESPACE/standby.omg-postgres-NAMESPACE-cluster.credentials\\\", uid: \\\"e0f0a203-bd9c-11e8-a89f-3085a93fc1bb\\\"\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=info msg=\"secrets have been successfully created\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=info msg=\"pod disruption budget \\\"NAMESPACE/postgres-omg-postgres-NAMESPACE-cluster-pdb\\\" has been successfully created\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=debug msg=\"created new statefulset \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster\\\", uid: \\\"e0f9ca62-bd9c-11e8-a89f-3085a93fc1bb\\\"\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=info msg=\"statefulset \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster\\\" has been successfully created\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:50:12Z\" level=info msg=\"waiting for the cluster being ready\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:36Z\" level=info msg=\"pods are ready\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=debug msg=\"closing database connection\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"users have been successfully created\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"creating database \\\"omg\\\" with owner \\\"okmapgo\\\"\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=debug msg=\"closing database connection\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"databases have been successfully created\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found pod disruption budget: \\\"NAMESPACE/postgres-omg-postgres-NAMESPACE-cluster-pdb\\\" (uid: \\\"e0f7086d-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found statefulset: \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster\\\" (uid: \\\"e0f9ca62-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found secret: \\\"NAMESPACE/okmapgo.omg-postgres-NAMESPACE-cluster.credentials\\\" (uid: \\\"e0ea5de3-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found secret: \\\"NAMESPACE/postgres.omg-postgres-NAMESPACE-cluster.credentials\\\" (uid: \\\"e0ecc0e0-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found secret: \\\"NAMESPACE/standby.omg-postgres-NAMESPACE-cluster.credentials\\\" (uid: \\\"e0f0a203-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found master endpoint: \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster\\\" (uid: \\\"e0d4b30c-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found master service: \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster\\\" (uid: \\\"e0e6a943-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found pod: \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster-0\\\" (uid: \\\"e1117681-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found pod: \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster-1\\\" (uid: \\\"e28ba850-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found pod: \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster-2\\\" (uid: \\\"e410075b-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found pod: \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster-3\\\" (uid: \\\"e54aae4e-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found pod: \\\"NAMESPACE/omg-postgres-NAMESPACE-cluster-4\\\" (uid: \\\"e864e9b5-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found PVC: \\\"NAMESPACE/pgdata-omg-postgres-NAMESPACE-cluster-0\\\" (uid: \\\"e10e7076-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found PVC: \\\"NAMESPACE/pgdata-omg-postgres-NAMESPACE-cluster-1\\\" (uid: \\\"e284c46f-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found PVC: \\\"NAMESPACE/pgdata-omg-postgres-NAMESPACE-cluster-2\\\" (uid: \\\"e40c7ff1-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found PVC: \\\"NAMESPACE/pgdata-omg-postgres-NAMESPACE-cluster-3\\\" (uid: \\\"e5478469-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"found PVC: \\\"NAMESPACE/pgdata-omg-postgres-NAMESPACE-cluster-4\\\" (uid: \\\"e8610d2e-bd9c-11e8-a89f-3085a93fc1bb\\\")\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:51:41Z\" level=info msg=\"cluster has been created\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=controller worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=info msg=\"\\\"SYNC\\\" event has been queued\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=controller worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=info msg=\"there are 1 clusters running\" pkg=controller\r\ntime=\"2018-09-21T12:58:46Z\" level=info msg=\"syncing of the cluster started\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=controller worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"team API is disabled, returning empty list of members\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"syncing secrets\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"secret \\\"NAMESPACE/okmapgo.omg-postgres-NAMESPACE-cluster.credentials\\\" already exists, fetching its password\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"secret \\\"NAMESPACE/postgres.omg-postgres-NAMESPACE-cluster.credentials\\\" already exists, fetching its password\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"secret \\\"NAMESPACE/standby.omg-postgres-NAMESPACE-cluster.credentials\\\" already exists, fetching its password\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"syncing services\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"syncing master service\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"syncing replica service\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"syncing statefulsets\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"syncing roles\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"closing database connection\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"syncing databases\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"closing database connection\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:46Z\" level=debug msg=\"syncing persistent volumes\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:47Z\" level=debug msg=\"syncing pod disruption budgets\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=cluster worker=0\r\ntime=\"2018-09-21T12:58:47Z\" level=info msg=\"cluster has been synced\" cluster-name=NAMESPACE/omg-postgres-NAMESPACE-cluster pkg=controller worker=0\r\n```"},"comment":{"url":"https://api.github.com/repos/zalando-incubator/postgres-operator/issues/comments/423536272","html_url":"https://github.com/zalando-incubator/postgres-operator/issues/393#issuecomment-423536272","issue_url":"https://api.github.com/repos/zalando-incubator/postgres-operator/issues/393","id":423536272,"node_id":"MDEyOklzc3VlQ29tbWVudDQyMzUzNjI3Mg==","user":{"login":"Jan-M","id":1443395,"node_id":"MDQ6VXNlcjE0NDMzOTU=","avatar_url":"https://avatars3.githubusercontent.com/u/1443395?v=4","gravatar_id":"","url":"https://api.github.com/users/Jan-M","html_url":"https://github.com/Jan-M","followers_url":"https://api.github.com/users/Jan-M/followers","following_url":"https://api.github.com/users/Jan-M/following{/other_user}","gists_url":"https://api.github.com/users/Jan-M/gists{/gist_id}","starred_url":"https://api.github.com/users/Jan-M/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Jan-M/subscriptions","organizations_url":"https://api.github.com/users/Jan-M/orgs","repos_url":"https://api.github.com/users/Jan-M/repos","events_url":"https://api.github.com/users/Jan-M/events{/privacy}","received_events_url":"https://api.github.com/users/Jan-M/received_events","type":"User","site_admin":false},"created_at":"2018-09-21T13:46:51Z","updated_at":"2018-09-21T13:46:51Z","author_association":"COLLABORATOR","body":"https://github.com/zalando-incubator/postgres-operator/releases/tag/v1.0.0 can you give this a try instead. should not change so much I am just not looking up the commit you use as it does not seem to be the latest.\r\n\r\nAlso the spilo image could be newer. @CyberDem0n "}}
{"actor":{"display_login":"Jan-M"}}