{"action":"created","issue":{"url":"https://api.github.com/repos/hazelcast/hazelcast/issues/12306","repository_url":"https://api.github.com/repos/hazelcast/hazelcast","labels_url":"https://api.github.com/repos/hazelcast/hazelcast/issues/12306/labels{/name}","comments_url":"https://api.github.com/repos/hazelcast/hazelcast/issues/12306/comments","events_url":"https://api.github.com/repos/hazelcast/hazelcast/issues/12306/events","html_url":"https://github.com/hazelcast/hazelcast/issues/12306","id":295980585,"number":12306,"title":"Hazelcast tcp discovery errors in cloud foundry with app service discovery","user":{"login":"chefhoobajoob","id":5960934,"avatar_url":"https://avatars0.githubusercontent.com/u/5960934?v=4","gravatar_id":"","url":"https://api.github.com/users/chefhoobajoob","html_url":"https://github.com/chefhoobajoob","followers_url":"https://api.github.com/users/chefhoobajoob/followers","following_url":"https://api.github.com/users/chefhoobajoob/following{/other_user}","gists_url":"https://api.github.com/users/chefhoobajoob/gists{/gist_id}","starred_url":"https://api.github.com/users/chefhoobajoob/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chefhoobajoob/subscriptions","organizations_url":"https://api.github.com/users/chefhoobajoob/orgs","repos_url":"https://api.github.com/users/chefhoobajoob/repos","events_url":"https://api.github.com/users/chefhoobajoob/events{/privacy}","received_events_url":"https://api.github.com/users/chefhoobajoob/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2018-02-09T19:13:05Z","updated_at":"2018-02-09T22:28:05Z","closed_at":null,"author_association":"NONE","body":"I am trying to get tcp discovery working in a cloud foundry environment that has support for [app service discovery](https://github.com/cloudfoundry/cf-app-sd-release) and [containter-to-container networking](https://github.com/cloudfoundry/cf-networking-release).\r\n\r\nThis is a [vert.x](http://vertx.io/) application using the [hazelcast cluster manager](http://vertx.io/docs/vertx-hazelcast/java/), so is running embedded hazelcast.\r\n\r\nI have a launch script that performs string replacement in the app's `cluster.xml` hazelcast configuration file prior to application startup. Specifically, this script will insert the `members` element as a child of the `hazelcast/network/join/tcp-ip` element [as documented here](http://docs.hazelcast.org/docs/latest-development/manual/html/Setting_Up_Clusters/Discovering_Members_by_TCP.html), and populate it with valid cloud foundry application instance host names, using [the conventions described here](https://github.com/cloudfoundry/cf-app-sd-release#app-developer-experience).\r\n\r\nThe value that is inserted in the `members` element is a comma-separated list of 3 host names, like so: `0.<app-guid>.apps.internal,1.<app-guid>.apps.internal,2.<app-guid>.apps.internal`\r\n\r\nI'm finding that the first instance of the app starts up without a problem, after failing to resolve the names in the list of members, as expected.\r\n\r\nHowever, when I start up the second instance of the app, I'm finding that both instances are first accepting connection requests from each other, and then closing the connections soon afterward. Inspecting the logs, I can't really determine why the nodes are rejecting these requests from each other.\r\n\r\nBy the time the second instance starts up, I believe that both `0.<app-guid>.apps.internal` and `1.<app-guid>.apps.internal` host names are resolving to the correct network addresses, otherwise no connections at all would be established.\r\n\r\nThe problem is not a networking infrastructure problem - addresses resolved by DNS queries are resulting in successful socket connections between containers, but hazelcast is rejecting the connections, once established.\r\n\r\nIs this a bug or am I doing something wrong?\r\n\r\n__`cluster.xml`__\r\n```xml\r\n<?xml version=\"1.0\" encoding=\"UTF-8\"?>\r\n<!--\r\n  ~ Copyright 2017 Red Hat, Inc.\r\n  ~\r\n  ~ Red Hat licenses this file to you under the Apache License, version 2.0\r\n  ~ (the \"License\"); you may not use this file except in compliance with the\r\n  ~ License.  You may obtain a copy of the License at:\r\n  ~\r\n  ~ http://www.apache.org/licenses/LICENSE-2.0\r\n  ~\r\n  ~ Unless required by applicable law or agreed to in writing, software\r\n  ~ distributed under the License is distributed on an \"AS IS\" BASIS, WITHOUT\r\n  ~ WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.  See the\r\n  ~ License for the specific language governing permissions and limitations\r\n  ~ under the License.\r\n  -->\r\n\r\n<hazelcast xsi:schemaLocation=\"http://www.hazelcast.com/schema/config hazelcast-config-3.8.xsd\"\r\n           xmlns=\"http://www.hazelcast.com/schema/config\"\r\n           xmlns:xsi=\"http://www.w3.org/2001/XMLSchema-instance\">\r\n  <properties>\r\n    <property name=\"hazelcast.mancenter.enabled\">false</property>\r\n    <property name=\"hazelcast.memcache.enabled\">false</property>\r\n    <property name=\"hazelcast.rest.enabled\">false</property>\r\n    <property name=\"hazelcast.wait.seconds.before.join\">0</property>\r\n    <property name=\"hazelcast.logging.type\">slf4j</property>\r\n\t<!-- property name=\"hazelcast.discovery.enabled\">true</property -->\r\n  </properties>\r\n\r\n  <group>\r\n    <name>nimbus</name>\r\n    <password>******</password>\r\n  </group>\r\n  <management-center enabled=\"false\">http://localhost:8080/mancenter</management-center>\r\n  <network>\r\n    <port auto-increment=\"true\" port-count=\"10000\">5701</port>\r\n    <outbound-ports>\r\n      <!--\r\n      Allowed port range when connecting to other nodes.\r\n      0 or * means use system provided port.\r\n      -->\r\n      <ports>0</ports>\r\n    </outbound-ports>\r\n    <join>\r\n      <multicast enabled=\"false\">\r\n        <multicast-group>224.2.2.3</multicast-group>\r\n        <multicast-port>54327</multicast-port>\r\n      </multicast>\r\n      <tcp-ip enabled=\"true\">\r\n        <interface>10.255.98.253</interface><members>0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal,1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal,2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal</members>\r\n      </tcp-ip>\r\n      <aws enabled=\"false\">\r\n        <access-key>my-access-key</access-key>\r\n        <secret-key>my-secret-key</secret-key>\r\n        <!--optional, default is us-east-1 -->\r\n        <region>us-west-1</region>\r\n        <!--optional, default is ec2.amazonaws.com. If set, region shouldn't be set as it will override this property -->\r\n        <host-header>ec2.amazonaws.com</host-header>\r\n        <!-- optional, only instances belonging to this group will be discovered, default will try all running instances -->\r\n        <security-group-name>hazelcast-sg</security-group-name>\r\n        <tag-key>type</tag-key>\r\n        <tag-value>hz-nodes</tag-value>\r\n      </aws>\r\n      <discovery-strategies>\r\n          <discovery-strategy class=\"com.hazelcast.eureka.one.EurekaOneDiscoveryStrategy\" enabled=\"false\">\r\n          <properties>\r\n            <property name=\"self-registration\">true</property>\r\n            <property name=\"namespace\">hazelcast</property>\r\n          </properties>\r\n        </discovery-strategy>\r\n      </discovery-strategies>\r\n    </join>\r\n    <interfaces enabled=\"false\">\r\n      <interface>10.10.1.*</interface>\r\n    </interfaces>\r\n    <ssl enabled=\"false\"/>\r\n    <socket-interceptor enabled=\"false\"/>\r\n    <symmetric-encryption enabled=\"false\">\r\n      <!--\r\n         encryption algorithm such as\r\n         DES/ECB/PKCS5Padding,\r\n         PBEWithMD5AndDES,\r\n         AES/CBC/PKCS5Padding,\r\n         Blowfish,\r\n         DESede\r\n      -->\r\n      <algorithm>PBEWithMD5AndDES</algorithm>\r\n      <!-- salt value to use when generating the secret key -->\r\n      <salt>thesalt</salt>\r\n      <!-- pass phrase to use when generating the secret key -->\r\n      <password>thepass</password>\r\n      <!-- iteration count to use when generating the secret key -->\r\n      <iteration-count>19</iteration-count>\r\n    </symmetric-encryption>\r\n  </network>\r\n  <partition-group enabled=\"false\"/>\r\n  <executor-service name=\"default\">\r\n    <pool-size>16</pool-size>\r\n    <!--Queue capacity. 0 means Integer.MAX_VALUE.-->\r\n    <queue-capacity>0</queue-capacity>\r\n  </executor-service>\r\n\r\n  <multimap name=\"__vertx.subs\">\r\n\r\n    <!--\r\n        Number of backups. If 1 is set as the backup-count for example,\r\n        then all entries of the map will be copied to another JVM for\r\n        fail-safety. 0 means no backup.\r\n    -->\r\n    <backup-count>1</backup-count>\r\n  </multimap>\r\n\r\n  <map name=\"__vertx.haInfo\">\r\n\r\n    <!--\r\n        Number of backups. If 1 is set as the backup-count for example,\r\n        then all entries of the map will be copied to another JVM for\r\n        fail-safety. 0 means no backup.\r\n    -->\r\n    <backup-count>1</backup-count>\r\n    <!--\r\n  Maximum number of seconds for each entry to stay in the map. Entries that are\r\n  older than <time-to-live-seconds> and not updated for <time-to-live-seconds>\r\n  will get automatically evicted from the map.\r\n  Any integer between 0 and Integer.MAX_VALUE. 0 means infinite. Default is 0.\r\n-->\r\n    <time-to-live-seconds>0</time-to-live-seconds>\r\n    <!--\r\n  Maximum number of seconds for each entry to stay idle in the map. Entries that are\r\n  idle(not touched) for more than <max-idle-seconds> will get\r\n  automatically evicted from the map. Entry is touched if get, put or containsKey is called.\r\n  Any integer between 0 and Integer.MAX_VALUE. 0 means infinite. Default is 0.\r\n-->\r\n    <max-idle-seconds>0</max-idle-seconds>\r\n    <!--\r\n        Valid values are:\r\n        NONE (no eviction),\r\n        LRU (Least Recently Used),\r\n        LFU (Least Frequently Used).\r\n        NONE is the default.\r\n    -->\r\n    <eviction-policy>NONE</eviction-policy>\r\n    <!--\r\n        Maximum size of the map. When max size is reached,\r\n        map is evicted based on the policy defined.\r\n        Any integer between 0 and Integer.MAX_VALUE. 0 means\r\n        Integer.MAX_VALUE. Default is 0.\r\n    -->\r\n    <max-size policy=\"PER_NODE\">0</max-size>\r\n    <!--\r\n        When max. size is reached, specified percentage of\r\n        the map will be evicted. Any integer between 0 and 100.\r\n        If 25 is set for example, 25% of the entries will\r\n        get evicted.\r\n    -->\r\n    <eviction-percentage>25</eviction-percentage>\r\n    <!--\r\n        While recovering from split-brain (network partitioning),\r\n        map entries in the small cluster will merge into the bigger cluster\r\n        based on the policy set here. When an entry merge into the\r\n        cluster, there might an existing entry with the same key already.\r\n        Values of these entries might be different for that same key.\r\n        Which value should be set for the key? Conflict is resolved by\r\n        the policy set here. Default policy is PutIfAbsentMapMergePolicy\r\n\r\n        There are built-in merge policies such as\r\n        com.hazelcast.map.merge.PassThroughMergePolicy; entry will be added if there is no existing entry for the key.\r\n        com.hazelcast.map.merge.PutIfAbsentMapMergePolicy ; entry will be added if the merging entry doesn't exist in the cluster.\r\n        com.hazelcast.map.merge.HigherHitsMapMergePolicy ; entry with the higher hits wins.\r\n        com.hazelcast.map.merge.LatestUpdateMapMergePolicy ; entry with the latest update wins.\r\n    -->\r\n    <merge-policy>com.hazelcast.map.merge.LatestUpdateMapMergePolicy</merge-policy>\r\n\r\n  </map>\r\n\r\n  <!-- Used internally in Vert.x to implement async locks -->\r\n  <semaphore name=\"__vertx.*\">\r\n    <initial-permits>1</initial-permits>\r\n  </semaphore>\r\n\r\n</hazelcast>\r\n```\r\n\r\n__Instance 1 Logs__\r\n```\r\n[vert.x-worker-thread-0] INFO  com.hazelcast.core.LifecycleService - [10.255.197.192]:5701 [nimbus] [3.8.2] [10.255.197.192]:5701 is STARTING \r\n[vert.x-worker-thread-0] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] Cannot resolve hostname '1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[vert.x-worker-thread-0] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Connecting to 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, timeout: 0, bind-any: true \r\n[hz._hzInstance_1_nimbus.cached.thread-2] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Connecting to 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5702, timeout: 0, bind-any: true \r\n[hz._hzInstance_1_nimbus.cached.thread-3] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Connecting to 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5703, timeout: 0, bind-any: true \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Connecting to /10.255.197.192:5703, timeout: 0, bind-any: true \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Could not connect to: /10.255.197.192:5703. Reason: SocketException[Connection refused to address /10.255.197.192:5703] \r\n[hz._hzInstance_1_nimbus.cached.thread-2] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Could not connect to: 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5702. Reason: SocketException[Connection refused to address 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5702] \r\n[hz._hzInstance_1_nimbus.cached.thread-2] INFO  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5702 is added to the blacklist. \r\n[hz._hzInstance_1_nimbus.cached.thread-3] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Could not connect to: 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5703. Reason: SocketException[Connection refused to address 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5703] \r\n[hz._hzInstance_1_nimbus.cached.thread-3] INFO  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5703 is added to the blacklist. \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] [10.255.197.192]:5703 is added to the blacklist. \r\n[hz._hzInstance_1_nimbus.cached.thread-5] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Connecting to /10.255.197.192:5702, timeout: 0, bind-any: true \r\n[hz._hzInstance_1_nimbus.cached.thread-5] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Could not connect to: /10.255.197.192:5702. Reason: SocketException[Connection refused to address /10.255.197.192:5702] \r\n[hz._hzInstance_1_nimbus.cached.thread-5] INFO  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] [10.255.197.192]:5702 is added to the blacklist. \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:57976 and 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=1, /10.255.197.192:57976->0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, endpoint=[0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=NONE] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Connecting to 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, timeout: 0, bind-any: true \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:52611 and 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=2, /10.255.197.192:52611->0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, endpoint=[0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=MEMBER] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Connecting to 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, timeout: 0, bind-any: true \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:45404 and 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=3, /10.255.197.192:45404->0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, endpoint=[0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=MEMBER] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Connecting to 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, timeout: 0, bind-any: true \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:42770 and 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=4, /10.255.197.192:42770->0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, endpoint=[0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=MEMBER] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.InitConnectionTask - [10.255.197.192]:5701 [nimbus] [3.8.2] Connecting to 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, timeout: 0, bind-any: true \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:55150 and 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=5, /10.255.197.192:55150->0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, endpoint=[0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=MEMBER] closed. Reason: Connection closed by the other side \r\n[vert.x-worker-thread-0] INFO  com.hazelcast.system - [10.255.197.192]:5701 [nimbus] [3.8.2] Cluster version set to 3.8 \r\n[vert.x-worker-thread-0] INFO  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] \r\n\r\n\r\nMembers [1] {\r\n\tMember [10.255.197.192]:5701 - 76843730-c0f9-4b62-a6a0-4132e6957094 this\r\n}\r\n\r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.197.192]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.98.253:44876 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:5701 and /10.255.98.253:44876 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=6, /10.255.197.192:5701->/10.255.98.253:44876, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.197.192]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.98.253:33755 \r\n[hz._hzInstance_1_nimbus.cached.thread-5] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:5701 and /10.255.98.253:33755 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=7, /10.255.197.192:5701->/10.255.98.253:33755, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:38576 and 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=8, /10.255.197.192:38576->0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, endpoint=[0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=MEMBER] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.197.192]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.98.253:56230 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:5701 and /10.255.98.253:56230 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=9, /10.255.197.192:5701->/10.255.98.253:56230, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-5] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:49584 and 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=10, /10.255.197.192:49584->0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, endpoint=[0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=MEMBER] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.197.192]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.98.253:45302 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:5701 and /10.255.98.253:45302 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=11, /10.255.197.192:5701->/10.255.98.253:45302, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-5] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:50006 and 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=12, /10.255.197.192:50006->0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, endpoint=[0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=MEMBER] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.197.192]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.98.253:55327 \r\n[hz._hzInstance_1_nimbus.cached.thread-5] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:5701 and /10.255.98.253:55327 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=13, /10.255.197.192:5701->/10.255.98.253:55327, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-5] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.197.192]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:40822 and 0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=14, /10.255.197.192:40822->0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.98.253:5701, endpoint=[0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=MEMBER] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.197.192]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.98.253:44037 \r\n[hz._hzInstance_1_nimbus.cached.thread-5] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.197.192:5701 and /10.255.98.253:44037 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.197.192]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.197.192]:5701 [nimbus] [3.8.2] Connection[id=15, /10.255.197.192:5701->/10.255.98.253:44037, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.98.253]:5701! This node is not requested endpoint: [1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n```\r\n\r\n__Instance 0 Logs__\r\n```\r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:57976 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:57976 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=1, /10.255.98.253:5701->/10.255.197.192:57976, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:52611 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:52611 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=2, /10.255.98.253:5701->/10.255.197.192:52611, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:45404 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:45404 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=3, /10.255.98.253:5701->/10.255.197.192:45404, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:42770 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:42770 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=4, /10.255.98.253:5701->/10.255.197.192:42770, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:55150 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:55150 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=5, /10.255.98.253:5701->/10.255.197.192:55150, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-4] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.98.253]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:44876 and 1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=6, /10.255.98.253:44876->1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701, endpoint=[1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=NONE] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.cached.thread-2] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.98.253]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:33755 and 1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=7, /10.255.98.253:33755->1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701, endpoint=[1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=NONE] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:38576 \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:38576 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=8, /10.255.98.253:5701->/10.255.197.192:38576, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-4] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.98.253]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-2] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:56230 and 1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=9, /10.255.98.253:56230->1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701, endpoint=[1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=NONE] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:49584 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:49584 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=10, /10.255.98.253:5701->/10.255.197.192:49584, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-1] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.98.253]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:45302 and 1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=11, /10.255.98.253:45302->1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701, endpoint=[1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=MEMBER] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:50006 \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:50006 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=12, /10.255.98.253:5701->/10.255.197.192:50006, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-2] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.98.253]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:55327 and 1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=13, /10.255.98.253:55327->1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701, endpoint=[1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=NONE] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:40822 \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:40822 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=14, /10.255.98.253:5701->/10.255.197.192:40822, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-4] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.98.253]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-1] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:44037 and 1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-2] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=15, /10.255.98.253:44037->1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701, endpoint=[1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=NONE] closed. Reason: Connection closed by the other side \r\n[hz._hzInstance_1_nimbus.IO.thread-Acceptor] INFO  c.h.nio.tcp.SocketAcceptorThread - [10.255.98.253]:5701 [nimbus] [3.8.2] Accepting socket connection from /10.255.197.192:52738 \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:5701 and /10.255.197.192:52738 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] WARN  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-0] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=16, /10.255.98.253:5701->/10.255.197.192:52738, endpoint=null, alive=false, type=MEMBER] closed. Reason: Wrong bind request from [10.255.197.192]:5701! This node is not requested endpoint: [0.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701 \r\n[hz._hzInstance_1_nimbus.cached.thread-5] WARN  c.hazelcast.cluster.impl.TcpIpJoiner - [10.255.98.253]:5701 [nimbus] [3.8.2] Cannot resolve hostname '2.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal'. Please make sure host is valid and reachable. \r\n[hz._hzInstance_1_nimbus.cached.thread-4] INFO  c.h.nio.tcp.TcpIpConnectionManager - [10.255.98.253]:5701 [nimbus] [3.8.2] Established socket connection between /10.255.98.253:36567 and 1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701 \r\n[hz._hzInstance_1_nimbus.IO.thread-in-1] INFO  c.hazelcast.nio.tcp.TcpIpConnection - [10.255.98.253]:5701 [nimbus] [3.8.2] Connection[id=17, /10.255.98.253:36567->1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal/10.255.197.192:5701, endpoint=[1.3269b1c0-c9c3-44b1-bcd1-361def211c09.apps.internal]:5701, alive=false, type=NONE] closed. Reason: Connection closed by the other side \r\n```"},"comment":{"url":"https://api.github.com/repos/hazelcast/hazelcast/issues/comments/364587663","html_url":"https://github.com/hazelcast/hazelcast/issues/12306#issuecomment-364587663","issue_url":"https://api.github.com/repos/hazelcast/hazelcast/issues/12306","id":364587663,"user":{"login":"chefhoobajoob","id":5960934,"avatar_url":"https://avatars0.githubusercontent.com/u/5960934?v=4","gravatar_id":"","url":"https://api.github.com/users/chefhoobajoob","html_url":"https://github.com/chefhoobajoob","followers_url":"https://api.github.com/users/chefhoobajoob/followers","following_url":"https://api.github.com/users/chefhoobajoob/following{/other_user}","gists_url":"https://api.github.com/users/chefhoobajoob/gists{/gist_id}","starred_url":"https://api.github.com/users/chefhoobajoob/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chefhoobajoob/subscriptions","organizations_url":"https://api.github.com/users/chefhoobajoob/orgs","repos_url":"https://api.github.com/users/chefhoobajoob/repos","events_url":"https://api.github.com/users/chefhoobajoob/events{/privacy}","received_events_url":"https://api.github.com/users/chefhoobajoob/received_events","type":"User","site_admin":false},"created_at":"2018-02-09T22:28:05Z","updated_at":"2018-02-09T22:28:05Z","author_association":"NONE","body":"What does this documentation [from here](http://docs.hazelcast.org/docs/latest-development/manual/html/Setting_Up_Clusters/Other_Network_Configurations.html#page_tcp-ip+element) mean?\r\n\r\n```\r\nmember:  IP address(es) of one or more well known members. Once members are connected to these well known ones, all member addresses will be communicated with each other...\r\n```\r\n\r\n...is this saying that all the listed members have to be present and communicating with each other before the cluster forms and they're all joined?"}}
{"actor":{"display_login":"chefhoobajoob"}}