{"action":"created","issue":{"url":"https://api.github.com/repos/rancher/rancher/issues/4376","repository_url":"https://api.github.com/repos/rancher/rancher","labels_url":"https://api.github.com/repos/rancher/rancher/issues/4376/labels{/name}","comments_url":"https://api.github.com/repos/rancher/rancher/issues/4376/comments","events_url":"https://api.github.com/repos/rancher/rancher/issues/4376/events","html_url":"https://github.com/rancher/rancher/issues/4376","id":147709286,"number":4376,"title":"Apache Kafka and zookeeper from the catalog","user":{"login":"eguswes","id":2749654,"avatar_url":"https://avatars.githubusercontent.com/u/2749654?v=3","gravatar_id":"","url":"https://api.github.com/users/eguswes","html_url":"https://github.com/eguswes","followers_url":"https://api.github.com/users/eguswes/followers","following_url":"https://api.github.com/users/eguswes/following{/other_user}","gists_url":"https://api.github.com/users/eguswes/gists{/gist_id}","starred_url":"https://api.github.com/users/eguswes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/eguswes/subscriptions","organizations_url":"https://api.github.com/users/eguswes/orgs","repos_url":"https://api.github.com/users/eguswes/repos","events_url":"https://api.github.com/users/eguswes/events{/privacy}","received_events_url":"https://api.github.com/users/eguswes/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/rancher/rancher/labels/kind/question","name":"kind/question","color":"dddddd"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-04-12T10:51:27Z","updated_at":"2016-05-26T03:38:28Z","closed_at":"2016-05-26T03:38:28Z","body":"*Describe your issue here*\r\n\r\nIt seems to be an issue here. The kafka service is frequently interrupted.\r\n\r\nThis is what I can see in the logs from zookeeper.\r\n\r\n4/12/2016 12:43:20 PMTue Apr 12 10:43:20 UTC 2016 - checking rancher network...\r\n4/12/2016 12:43:31 PMtail: can't open '/opt/zk/logs/zookeeper.out': No such file or directory\r\n4/12/2016 12:43:31 PMTue Apr 12 10:43:31 UTC 2016 - [ Static zk configuration... ]\r\n4/12/2016 12:43:31 PMTue Apr 12 10:43:31 UTC 2016 - [ Getting zk configuration... ]\r\n4/12/2016 12:43:31 PM2016-04-12T10:43:31Z 9d8e625ad063 /usr/bin/confd[25]: INFO Backend set to rancher\r\n4/12/2016 12:43:31 PM2016-04-12T10:43:31Z 9d8e625ad063 /usr/bin/confd[25]: INFO Starting confd\r\n4/12/2016 12:43:31 PM2016-04-12T10:43:31Z 9d8e625ad063 /usr/bin/confd[25]: INFO Backend nodes set to \r\n4/12/2016 12:43:31 PM2016-04-12T10:43:31Z 9d8e625ad063 /usr/bin/confd[25]: INFO Using Rancher Metadata URL: http://rancher-metadata\r\n4/12/2016 12:43:31 PM2016-04-12T10:43:31Z 9d8e625ad063 /usr/bin/confd[25]: INFO Target config /opt/zk/data/myid out of sync\r\n4/12/2016 12:43:31 PM2016-04-12T10:43:31Z 9d8e625ad063 /usr/bin/confd[25]: INFO Target config /opt/zk/data/myid has been updated\r\n4/12/2016 12:43:31 PM2016-04-12T10:43:31Z 9d8e625ad063 /usr/bin/confd[25]: INFO Target config /opt/zk/conf/zoo.cfg out of sync\r\n4/12/2016 12:43:35 PMtail: /opt/zk/logs/zookeeper.out has appeared; following end of new file\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,333 [myid:] - INFO  [main:QuorumPeerConfig@103] - Reading configuration from: /opt/zk/bin/../conf/zoo.cfg\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,340 [myid:] - INFO  [main:QuorumPeerConfig@340] - Defaulting to majority quorums\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,343 [myid:3] - INFO  [main:DatadirCleanupManager@78] - autopurge.snapRetainCount set to 3\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,343 [myid:3] - INFO  [main:DatadirCleanupManager@79] - autopurge.purgeInterval set to 1\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,347 [myid:3] - INFO  [PurgeTask:DatadirCleanupManager$PurgeTask@138] - Purge task started.\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,356 [myid:3] - INFO  [main:QuorumPeerMain@127] - Starting quorum peer\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,362 [myid:3] - INFO  [PurgeTask:DatadirCleanupManager$PurgeTask@144] - Purge task completed.\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,371 [myid:3] - INFO  [main:NIOServerCnxnFactory@94] - binding to port 0.0.0.0/0.0.0.0:2181\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,382 [myid:3] - INFO  [main:QuorumPeer@959] - tickTime set to 2000\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,382 [myid:3] - INFO  [main:QuorumPeer@979] - minSessionTimeout set to -1\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,382 [myid:3] - INFO  [main:QuorumPeer@990] - maxSessionTimeout set to -1\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,382 [myid:3] - INFO  [main:QuorumPeer@1005] - initLimit set to 10\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,395 [myid:3] - INFO  [main:QuorumPeer@473] - currentEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,398 [myid:3] - INFO  [main:QuorumPeer@488] - acceptedEpoch not found! Creating with a reasonable default of 0. This should only happen when you are upgrading your installation\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,405 [myid:3] - INFO  [Thread-2:QuorumCnxManager$Listener@504] - My election bind port: /10.42.67.126:3888\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,413 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:QuorumPeer@714] - LOOKING\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,419 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:FastLeaderElection@815] - New election. My id =  3, proposed zxid=0x0\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,435 [myid:3] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@597] - Notification: 1 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 1 (n.sid), 0x0 (n.peerEpoch) LOOKING (my state)\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,436 [myid:3] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@597] - Notification: 1 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), FOLLOWING (n.state), 1 (n.sid), 0x0 (n.peerEpoch) LOOKING (my state)\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,436 [myid:3] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@597] - Notification: 1 (message format version), 3 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 3 (n.sid), 0x0 (n.peerEpoch) LOOKING (my state)\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,437 [myid:3] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@597] - Notification: 1 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LOOKING (n.state), 2 (n.sid), 0x0 (n.peerEpoch) LOOKING (my state)\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,438 [myid:3] - INFO  [WorkerReceiver[myid=3]:FastLeaderElection@597] - Notification: 1 (message format version), 2 (n.leader), 0x0 (n.zxid), 0x1 (n.round), LEADING (n.state), 2 (n.sid), 0x0 (n.peerEpoch) LOOKING (my state)\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,439 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:QuorumPeer@784] - FOLLOWING\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,443 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Learner@86] - TCP NoDelay set to: true\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,448 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,448 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:host.name=9d8e625ad063\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,448 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.version=1.8.0_66\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,448 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.vendor=Oracle Corporation\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,448 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.home=/opt/jre1.8.0_66\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,448 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.class.path=/opt/zk/bin/../build/classes:/opt/zk/bin/../build/lib/*.jar:/opt/zk/bin/../lib/slf4j-log4j12-1.6.1.jar:/opt/zk/bin/../lib/slf4j-api-1.6.1.jar:/opt/zk/bin/../lib/netty-3.7.0.Final.jar:/opt/zk/bin/../lib/log4j-1.2.16.jar:/opt/zk/bin/../lib/jline-0.9.94.jar:/opt/zk/bin/../zookeeper-3.4.6.jar:/opt/zk/bin/../src/java/lib/*.jar:/opt/zk/bin/../conf:\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,448 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,448 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.io.tmpdir=/tmp\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,449 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:java.compiler=<NA>\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,449 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.name=Linux\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,449 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.arch=amd64\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,449 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:os.version=3.10.0-327.4.4.el7.x86_64\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,449 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.name=root\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,449 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.home=/root\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,449 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Environment@100] - Server environment:user.dir=/opt/zk\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,450 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:ZooKeeperServer@162] - Created server with tickTime 2000 minSessionTimeout 4000 maxSessionTimeout 40000 datadir /opt/zk/data/version-2 snapdir /opt/zk/data/version-2\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,451 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Follower@63] - FOLLOWING - LEADER ELECTION TOOK - 32\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,472 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:Learner@323] - Getting a diff from the leader 0x0\r\n4/12/2016 12:43:35 PM2016-04-12 10:43:35,474 [myid:3] - INFO  [QuorumPeer[myid=3]/0:0:0:0:0:0:0:0:2181:FileTxnSnapLog@240] - Snapshotting: 0x0 to /opt/zk/data/version-2/snapshot.0\r\n4/12/2016 12:43:35 PM2016-04-12T10:43:35Z 9d8e625ad063 /usr/bin/confd[25]: INFO Target config /opt/zk/conf/zoo.cfg has been updated\r\n4/12/2016 12:43:35 PMTue Apr 12 10:43:35 UTC 2016 - [ Starting monit... ]\r\n4/12/2016 12:43:36 PM New Monit id: 92a28379f6707d7558c4653f57a9b40d\r\n4/12/2016 12:43:36 PM Stored in '/root/.monit.id'\r\n4/12/2016 12:43:36 PMStarting Monit 5.15 daemon with http interface at [*]:2812\r\n4/12/2016 12:44:36 PM2016-04-12 10:44:36,094 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /0:0:0:0:0:0:0:1:44967\r\n4/12/2016 12:44:36 PM2016-04-12 10:44:36,168 [myid:3] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception\r\n4/12/2016 12:44:36 PMEndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket\r\n4/12/2016 12:44:36 PM\tat org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)\r\n4/12/2016 12:44:36 PM\tat org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)\r\n4/12/2016 12:44:36 PM\tat java.lang.Thread.run(Thread.java:745)\r\n4/12/2016 12:44:36 PM2016-04-12 10:44:36,171 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for client /0:0:0:0:0:0:0:1:44967 (no session established for client)\r\n4/12/2016 12:45:36 PM2016-04-12 10:45:36,096 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /0:0:0:0:0:0:0:1:45107\r\n4/12/2016 12:45:36 PM2016-04-12 10:45:36,096 [myid:3] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception\r\n4/12/2016 12:45:36 PMEndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket\r\n4/12/2016 12:45:36 PM\tat org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)\r\n4/12/2016 12:45:36 PM\tat org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)\r\n4/12/2016 12:45:36 PM\tat java.lang.Thread.run(Thread.java:745)\r\n4/12/2016 12:45:36 PM2016-04-12 10:45:36,097 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for client /0:0:0:0:0:0:0:1:45107 (no session established for client)\r\n4/12/2016 12:46:36 PM2016-04-12 10:46:36,102 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /0:0:0:0:0:0:0:1:45241\r\n4/12/2016 12:46:36 PM2016-04-12 10:46:36,103 [myid:3] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception\r\n4/12/2016 12:46:36 PMEndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket\r\n4/12/2016 12:46:36 PM\tat org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)\r\n4/12/2016 12:46:36 PM\tat org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)\r\n4/12/2016 12:46:36 PM\tat java.lang.Thread.run(Thread.java:745)\r\n4/12/2016 12:46:36 PM2016-04-12 10:46:36,103 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for client /0:0:0:0:0:0:0:1:45241 (no session established for client)\r\n4/12/2016 12:47:36 PM2016-04-12 10:47:36,111 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /0:0:0:0:0:0:0:1:45379\r\n4/12/2016 12:47:36 PM2016-04-12 10:47:36,112 [myid:3] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@357] - caught end of stream exception\r\n4/12/2016 12:47:36 PMEndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket\r\n4/12/2016 12:47:36 PM\tat org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)\r\n4/12/2016 12:47:36 PM\tat org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)\r\n4/12/2016 12:47:36 PM\tat java.lang.Thread.run(Thread.java:745)\r\n4/12/2016 12:47:36 PM2016-04-12 10:47:36,112 [myid:3] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1007] - Closed socket connection for client /0:0:0:0:0:0:0:1:45379 (no session established for client)\r\n\r\nZookeeper\r\n3.4.6-RANCHER\r\n\r\nKafka\r\n0.9.0-Rancher\r\n\r\n---\r\n| Useful | Info |\r\n| :-- | :-- |\r\n|Versions|Rancher `v1.0.0` Cattle: `v0.159.2` UI: `v0.100.3` |\r\n|Access|`Disabled`|\r\n|Route|`authenticated.project.help`|\r\n"},"comment":{"url":"https://api.github.com/repos/rancher/rancher/issues/comments/221769671","html_url":"https://github.com/rancher/rancher/issues/4376#issuecomment-221769671","issue_url":"https://api.github.com/repos/rancher/rancher/issues/4376","id":221769671,"user":{"login":"deniseschannon","id":11410997,"avatar_url":"https://avatars.githubusercontent.com/u/11410997?v=3","gravatar_id":"","url":"https://api.github.com/users/deniseschannon","html_url":"https://github.com/deniseschannon","followers_url":"https://api.github.com/users/deniseschannon/followers","following_url":"https://api.github.com/users/deniseschannon/following{/other_user}","gists_url":"https://api.github.com/users/deniseschannon/gists{/gist_id}","starred_url":"https://api.github.com/users/deniseschannon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/deniseschannon/subscriptions","organizations_url":"https://api.github.com/users/deniseschannon/orgs","repos_url":"https://api.github.com/users/deniseschannon/repos","events_url":"https://api.github.com/users/deniseschannon/events{/privacy}","received_events_url":"https://api.github.com/users/deniseschannon/received_events","type":"User","site_admin":false},"created_at":"2016-05-26T03:38:27Z","updated_at":"2016-05-26T03:38:27Z","body":"@eguswes As I mentioned, it's best if you open your issue in the other repo. Thanks!"}}
{"actor":{"display_login":"deniseschannon"}}