{"action":"created","issue":{"url":"https://api.github.com/repos/allegro/hermes/issues/411","repository_url":"https://api.github.com/repos/allegro/hermes","labels_url":"https://api.github.com/repos/allegro/hermes/issues/411/labels{/name}","comments_url":"https://api.github.com/repos/allegro/hermes/issues/411/comments","events_url":"https://api.github.com/repos/allegro/hermes/issues/411/events","html_url":"https://github.com/allegro/hermes/issues/411","id":141717315,"number":411,"title":"Timeout while posting http message ","user":{"login":"hikrrish","id":17607599,"avatar_url":"https://avatars.githubusercontent.com/u/17607599?v=3","gravatar_id":"","url":"https://api.github.com/users/hikrrish","html_url":"https://github.com/hikrrish","followers_url":"https://api.github.com/users/hikrrish/followers","following_url":"https://api.github.com/users/hikrrish/following{/other_user}","gists_url":"https://api.github.com/users/hikrrish/gists{/gist_id}","starred_url":"https://api.github.com/users/hikrrish/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hikrrish/subscriptions","organizations_url":"https://api.github.com/users/hikrrish/orgs","repos_url":"https://api.github.com/users/hikrrish/repos","events_url":"https://api.github.com/users/hikrrish/events{/privacy}","received_events_url":"https://api.github.com/users/hikrrish/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2016-03-17T21:56:17Z","updated_at":"2016-03-21T20:20:35Z","closed_at":null,"body":"I am getting async time out while posting a message to a topic \r\n\r\nExact error message : \r\n{\r\n  \"message\": \"Async timeout, cause: unknown\",\r\n  \"code\": \"TIMEOUT\"\r\n}\r\n\r\nHeaders \r\nContent-Length →60\r\nContent-Type →application/json;charset=ISO-8859-1\r\nDate →Thu, 17 Mar 2016 21:46:38 GMT\r\nHermes-Message-Id →9ca198b8-29e5-4123-8781-34cc787bf188\r\n\r\nFrontend server log \r\n\r\n\r\n2016-03-17 21:46:38.453 ERROR p.a.t.h.f.publishing.HttpResponder - Async timeout, cause: unknown, publishing on topic com.krishna.cash, remote host 10.81.90.115, message state SENDING_TO_KAFKA_PRODUCER_QUEUE\r\n2016-03-17 21:46:38.571 ERROR p.a.t.h.f.publishing.HttpResponder - Async timeout, cause: unknown, publishing on topic com.krishna.cash, remote host 10.81.90.115, message state SENDING_TO_KAFKA_PRODUCER_QUEUE\r\n\r\nI have tested manually my kafka cluster and its healthy \r\n\r\nAs soon as I create a topic , I can see a directory is created in kafka as shown below and Hermes management is working fine \r\n\r\ndrwx------ 2 kafka kafka   4096 Mar 17 21:39 com.krishna.cash-1\r\ndrwx------ 2 kafka kafka   4096 Mar 17 21:39 com.krishna.cash-4\r\ndrwx------ 2 kafka kafka   4096 Mar 17 21:39 com.krishna.cash-7\r\ndrwx------ 2 kafka kafka   4096 Mar 17 21:37 com.krishna.cash-1\r\ndrwx------ 2 kafka kafka   4096 Mar 17 20:52 com.krishna.cash-4\r\ndrwx------ 2 kafka kafka   4096 Mar 17 20:52 com.krishna.cash-7\r\n\r\nNote: my kafka-zookeeper and hermes zookeeper are separate clusters  \r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/allegro/hermes/issues/comments/199459488","html_url":"https://github.com/allegro/hermes/issues/411#issuecomment-199459488","issue_url":"https://api.github.com/repos/allegro/hermes/issues/411","id":199459488,"user":{"login":"hikrrish","id":17607599,"avatar_url":"https://avatars.githubusercontent.com/u/17607599?v=3","gravatar_id":"","url":"https://api.github.com/users/hikrrish","html_url":"https://github.com/hikrrish","followers_url":"https://api.github.com/users/hikrrish/followers","following_url":"https://api.github.com/users/hikrrish/following{/other_user}","gists_url":"https://api.github.com/users/hikrrish/gists{/gist_id}","starred_url":"https://api.github.com/users/hikrrish/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hikrrish/subscriptions","organizations_url":"https://api.github.com/users/hikrrish/orgs","repos_url":"https://api.github.com/users/hikrrish/repos","events_url":"https://api.github.com/users/hikrrish/events{/privacy}","received_events_url":"https://api.github.com/users/hikrrish/received_events","type":"User","site_admin":false},"created_at":"2016-03-21T20:20:35Z","updated_at":"2016-03-21T20:20:35Z","body":"Here is the configuration for frontend and consumers, created a single file and using \r\n\r\nexport HERMES_CONSUMERS_OPTS=\"-Darchaius.configurationSource.additionalUrls=file:///opt/hermes/conf/hermes-frontend.properties\"\r\nexport HERMES_FRONTEND_OPTS=\"-Darchaius.configurationSource.additionalUrls=file:///opt/hermes/conf/hermes-frontend.properties\"\r\n\r\nto run them \r\n\r\nzookeeper.connect.string=10.81.88.50:2181,10.81.85.7:2181,10.81.86.211:2181\r\nzookeeper.connection.timeout=10000\r\nzookeeper.max.retries=20\r\nzookeeper.base.sleep.time=1000\r\nzookeeper.root.storage.pathPrefix=/hermes\r\nzookeeper.cache.thread.pool.size=5\r\nzookeeper.authorization.enabled=false\r\nzookeeper.authorization.password=password\r\nkafka.broker.list=10.81.86.117:9092,10.81.85.208:9092,10.81.89.72:9092\r\nkafka.zookeeper.connect.string=10.81.86.117:2181,10.81.85.208:2181,10.81.89.72:2181\r\n\r\nFor management created yml file as below \r\n\r\nkafka:\r\n  clusters:\r\n    -\r\n      clusterName: \r\n      connectionString: 10.81.86.117:2181,10.81.85.208:2181,10.81.89.72:2181\r\n\r\n\r\nstorage:\r\n  connectionString: 10.81.88.50:2181,10.81.85.7:2181,10.81.86.211:2181\r\n  connectionTimeout: 3000\r\n\r\nexport HERMES_MANAGEMENT_OPTS=\"-Dspring.config.location=/opt/hermes/conf/hermes-mgmt.yml\"\r\n\r\nSeparate IP's for hermes Metadata ZK and Kafka Metadata ZK\r\n\r\nCan you please check if anything wrong?\r\n"}}