{"action":"created","issue":{"url":"https://api.github.com/repos/dadoonet/fscrawler/issues/233","repository_url":"https://api.github.com/repos/dadoonet/fscrawler","labels_url":"https://api.github.com/repos/dadoonet/fscrawler/issues/233/labels{/name}","comments_url":"https://api.github.com/repos/dadoonet/fscrawler/issues/233/comments","events_url":"https://api.github.com/repos/dadoonet/fscrawler/issues/233/events","html_url":"https://github.com/dadoonet/fscrawler/issues/233","id":183610971,"number":233,"title":"Failing to create index in Elastic Cloud (fscrawler 2.2)","user":{"login":"FrodeRennemo","id":1510800,"avatar_url":"https://avatars.githubusercontent.com/u/1510800?v=3","gravatar_id":"","url":"https://api.github.com/users/FrodeRennemo","html_url":"https://github.com/FrodeRennemo","followers_url":"https://api.github.com/users/FrodeRennemo/followers","following_url":"https://api.github.com/users/FrodeRennemo/following{/other_user}","gists_url":"https://api.github.com/users/FrodeRennemo/gists{/gist_id}","starred_url":"https://api.github.com/users/FrodeRennemo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/FrodeRennemo/subscriptions","organizations_url":"https://api.github.com/users/FrodeRennemo/orgs","repos_url":"https://api.github.com/users/FrodeRennemo/repos","events_url":"https://api.github.com/users/FrodeRennemo/events{/privacy}","received_events_url":"https://api.github.com/users/FrodeRennemo/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/dadoonet/fscrawler/labels/bug","name":"bug","color":"e11d21"}],"state":"open","locked":false,"assignee":{"login":"dadoonet","id":274222,"avatar_url":"https://avatars.githubusercontent.com/u/274222?v=3","gravatar_id":"","url":"https://api.github.com/users/dadoonet","html_url":"https://github.com/dadoonet","followers_url":"https://api.github.com/users/dadoonet/followers","following_url":"https://api.github.com/users/dadoonet/following{/other_user}","gists_url":"https://api.github.com/users/dadoonet/gists{/gist_id}","starred_url":"https://api.github.com/users/dadoonet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dadoonet/subscriptions","organizations_url":"https://api.github.com/users/dadoonet/orgs","repos_url":"https://api.github.com/users/dadoonet/repos","events_url":"https://api.github.com/users/dadoonet/events{/privacy}","received_events_url":"https://api.github.com/users/dadoonet/received_events","type":"User","site_admin":false},"assignees":[{"login":"dadoonet","id":274222,"avatar_url":"https://avatars.githubusercontent.com/u/274222?v=3","gravatar_id":"","url":"https://api.github.com/users/dadoonet","html_url":"https://github.com/dadoonet","followers_url":"https://api.github.com/users/dadoonet/followers","following_url":"https://api.github.com/users/dadoonet/following{/other_user}","gists_url":"https://api.github.com/users/dadoonet/gists{/gist_id}","starred_url":"https://api.github.com/users/dadoonet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dadoonet/subscriptions","organizations_url":"https://api.github.com/users/dadoonet/orgs","repos_url":"https://api.github.com/users/dadoonet/repos","events_url":"https://api.github.com/users/dadoonet/events{/privacy}","received_events_url":"https://api.github.com/users/dadoonet/received_events","type":"User","site_admin":false}],"milestone":null,"comments":3,"created_at":"2016-10-18T07:36:46Z","updated_at":"2016-10-18T09:32:46Z","closed_at":null,"body":"Hi,\r\n\r\nI'm able to use the crawler successfully on localhost, but now we're moving the index to Elastic Cloud(5.0 RC1).\r\n\r\n<b>Settings(user,pw and host not here)</b>\r\n\r\n```\r\n{\r\n  \"name\" : \"cloud\",\r\n  \"fs\" : {\r\n    \"url\" : \"C:/Test/articles\",\r\n    \"update_rate\" : \"15m\",\r\n    \"json_support\" : true,\r\n    \"filename_as_id\" : false,\r\n    \"add_filesize\" : true,\r\n    \"remove_deleted\" : true,\r\n    \"store_source\" : false,\r\n    \"index_content\" : true,\r\n    \"attributes_support\" : false,\r\n    \"raw_metadata\" : true,\r\n    \"xml_support\" : false\r\n  },\r\n  \"elasticsearch\" : {\r\n    \"username\" : \"\",\r\n    \"password\" : \"\",\r\n    \"nodes\" : [ {\r\n      \"host\" : \"\",\r\n      \"port\" : 9200\r\n    } ],\r\n    \"type\" : \"doc\",\r\n    \"bulk_size\" : 100,\r\n    \"flush_interval\" : \"5s\"\r\n  }\r\n}\r\n```\r\n\r\n<b>Running with trace </b>\r\n\r\n```\r\n09:17:56,279 DEBUG [f.p.e.c.f.u.FsCrawlerUtil] Copying [1/doc.json]...\r\n09:17:56,279 DEBUG [f.p.e.c.f.u.FsCrawlerUtil] Copying [1/folder.json]...\r\n09:17:56,279 DEBUG [f.p.e.c.f.u.FsCrawlerUtil] Copying [2/doc.json]...\r\n09:17:56,279 DEBUG [f.p.e.c.f.u.FsCrawlerUtil] Copying [2/folder.json]...\r\n09:17:56,279 DEBUG [f.p.e.c.f.u.FsCrawlerUtil] Copying [5/doc.json]...\r\n09:17:56,279 DEBUG [f.p.e.c.f.u.FsCrawlerUtil] Copying [5/folder.json]...\r\n09:17:56,294 DEBUG [f.p.e.c.f.FsCrawler] Starting job [cloud]...\r\n09:17:56,379 TRACE [f.p.e.c.f.FsCrawler] settings used for this crawler: [{\r\n  \"name\" : \"cloud\",\r\n  \"fs\" : {\r\n    \"url\" : \"C:/Test/articles\",\r\n    \"update_rate\" : \"15m\",\r\n    \"json_support\" : true,\r\n    \"filename_as_id\" : false,\r\n    \"add_filesize\" : true,\r\n    \"remove_deleted\" : true,\r\n    \"store_source\" : false,\r\n    \"index_content\" : true,\r\n    \"attributes_support\" : false,\r\n    \"raw_metadata\" : true,\r\n    \"xml_support\" : false\r\n  },\r\n  \"elasticsearch\" : {\r\n    \"nodes\" : [ {\r\n      \"host\" : \"\",\r\n      \"port\" : 9200\r\n    } ],\r\n    \"type\" : \"doc\",\r\n    \"bulk_size\" : 100,\r\n    \"flush_interval\" : \"5s\",\r\n    \"username\" : \"\",\r\n    \"password\" : \"\"\r\n  }\r\n}]\r\n09:17:56,379 INFO  [f.p.e.c.f.FsCrawlerImpl] Starting FS crawler\r\n09:17:56,379 INFO  [f.p.e.c.f.FsCrawlerImpl] FS crawler started in watch mode. It will run unless you stop it with CTRL+C.\r\n09:17:56,657 DEBUG [f.p.e.c.f.c.ElasticsearchClient] create index [cloud]\r\n09:17:57,715 WARN  [f.p.e.c.f.FsCrawlerImpl] failed to create index [cloud], disabling crawler...\r\n09:17:57,715 FATAL [f.p.e.c.f.FsCrawler] Fatal error received while running the crawler: [null]\r\n09:17:57,715 DEBUG [f.p.e.c.f.FsCrawler] error caught\r\njava.net.ConnectException\r\n        at org.apache.http.nio.pool.RouteSpecificPool.timeout(RouteSpecificPool.java:168) ~[httpcore-nio-4.4.5.jar:4.4.5]\r\n        at org.apache.http.nio.pool.AbstractNIOConnPool.requestTimeout(AbstractNIOConnPool.java:561) ~[httpcore-nio-4.4.5.jar:4.4.5]\r\n        at org.apache.http.nio.pool.AbstractNIOConnPool$InternalSessionRequestCallback.timeout(AbstractNIOConnPool.java:822) ~[httpcore-nio-4.4.5.jar:4.4.5]\r\n        at org.apache.http.impl.nio.reactor.SessionRequestImpl.timeout(SessionRequestImpl.java:183) ~[httpcore-nio-4.4.5.jar:4.4.5]\r\n        at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.processTimeouts(DefaultConnectingIOReactor.java:210) ~[httpcore-nio-4.4.5.jar:4.4.5]\r\n        at org.apache.http.impl.nio.reactor.DefaultConnectingIOReactor.processEvents(DefaultConnectingIOReactor.java:155) ~[httpcore-nio-4.4.5.jar:4.4.5]\r\n        at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor.execute(AbstractMultiworkerIOReactor.java:348) ~[httpcore-nio-4.4.5.jar:4.4.5]\r\n        at org.apache.http.impl.nio.conn.PoolingNHttpClientConnectionManager.execute(PoolingNHttpClientConnectionManager.java:192) ~[httpasyncclient-4.1.2.jar:4.1.2]\r\n        at org.apache.http.impl.nio.client.CloseableHttpAsyncClientBase$1.run(CloseableHttpAsyncClientBase.java:64) ~[httpasyncclient-4.1.2.jar:4.1.2]\r\n        at java.lang.Thread.run(Thread.java:745) ~[?:1.8.0_102]\r\n09:17:57,730 DEBUG [f.p.e.c.f.FsCrawlerImpl] Closing FS crawler [cloud]\r\n09:17:57,730 DEBUG [f.p.e.c.f.c.ElasticsearchClient] Closing REST client\r\n```\r\n\r\nPutting \"http://\" in front of host returns UnknownHostException. I have also tried using the https endpoint but the same error occurs. \r\n\r\nAny idea what's causing this?"},"comment":{"url":"https://api.github.com/repos/dadoonet/fscrawler/issues/comments/254456165","html_url":"https://github.com/dadoonet/fscrawler/issues/233#issuecomment-254456165","issue_url":"https://api.github.com/repos/dadoonet/fscrawler/issues/233","id":254456165,"user":{"login":"dadoonet","id":274222,"avatar_url":"https://avatars.githubusercontent.com/u/274222?v=3","gravatar_id":"","url":"https://api.github.com/users/dadoonet","html_url":"https://github.com/dadoonet","followers_url":"https://api.github.com/users/dadoonet/followers","following_url":"https://api.github.com/users/dadoonet/following{/other_user}","gists_url":"https://api.github.com/users/dadoonet/gists{/gist_id}","starred_url":"https://api.github.com/users/dadoonet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dadoonet/subscriptions","organizations_url":"https://api.github.com/users/dadoonet/orgs","repos_url":"https://api.github.com/users/dadoonet/repos","events_url":"https://api.github.com/users/dadoonet/events{/privacy}","received_events_url":"https://api.github.com/users/dadoonet/received_events","type":"User","site_admin":false},"created_at":"2016-10-18T09:32:46Z","updated_at":"2016-10-18T09:32:46Z","body":"No idea. Network timeout? Proxy? That's why I want to test it and BTW add support for https."}}
{"actor":{"display_login":"dadoonet"}}