{"action":"opened","issue":{"url":"https://api.github.com/repos/codelibs/gitbucket-fess-plugin/issues/20","repository_url":"https://api.github.com/repos/codelibs/gitbucket-fess-plugin","labels_url":"https://api.github.com/repos/codelibs/gitbucket-fess-plugin/issues/20/labels{/name}","comments_url":"https://api.github.com/repos/codelibs/gitbucket-fess-plugin/issues/20/comments","events_url":"https://api.github.com/repos/codelibs/gitbucket-fess-plugin/issues/20/events","html_url":"https://github.com/codelibs/gitbucket-fess-plugin/issues/20","id":296675251,"number":20,"title":"[question] what kind of http request method using with file crawling?","user":{"login":"sho-suzuki","id":512636,"avatar_url":"https://avatars1.githubusercontent.com/u/512636?v=4","gravatar_id":"","url":"https://api.github.com/users/sho-suzuki","html_url":"https://github.com/sho-suzuki","followers_url":"https://api.github.com/users/sho-suzuki/followers","following_url":"https://api.github.com/users/sho-suzuki/following{/other_user}","gists_url":"https://api.github.com/users/sho-suzuki/gists{/gist_id}","starred_url":"https://api.github.com/users/sho-suzuki/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sho-suzuki/subscriptions","organizations_url":"https://api.github.com/users/sho-suzuki/orgs","repos_url":"https://api.github.com/users/sho-suzuki/repos","events_url":"https://api.github.com/users/sho-suzuki/events{/privacy}","received_events_url":"https://api.github.com/users/sho-suzuki/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-02-13T09:54:57Z","updated_at":"2018-02-13T09:54:57Z","closed_at":null,"author_association":"NONE","body":"# plugin version\r\n1.3.1\r\n# gitbucket version\r\n4.20\r\n# what is matter\r\nunder the **proxy environment** . I can't get content from files but can get issue, wikis.\r\nfess-crawler.log  is as follows,\r\n\r\n```bash\r\n# file crawling log\r\n2018-02-13 18:12:32,511 [5DFNjmEBO7Desvq7XhyO-1] INFO  Get a content from http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/hoge\r\n[2018-02-13 18:12:35,028 [5DFNjmEBO7Desvq7XhyO-1] WARN  Failed to access to http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/hoge?ref=b7d5e8b5fba9a7927ff2b5106066e790ad2ced4e\r\norg.codelibs.fess.crawler.exception.CrawlingAccessException: Failed to parse http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/hoge?ref=b7d5e8b5fba9a7927ff2b5106066e790ad2ced4e&large_file=true\r\n        at org.codelibs.fess.helper.DocumentHelper.processRequest(DocumentHelper.java:184) ~[classes/:?]\r\n        at org.codelibs.fess.ds.impl.GitBucketDataStoreImpl.storeFileContent(GitBucketDataStoreImpl.java:291) ~[classes/:?]\r\n        at org.codelibs.fess.ds.impl.GitBucketDataStoreImpl.lambda$storeData$4713(GitBucketDataStoreImpl.java:134) ~[classes/:?]\r\n        at org.codelibs.fess.ds.impl.GitBucketDataStoreImpl.crawlFileContents(GitBucketDataStoreImpl.java:441) [classes/:?]\r\n        at org.codelibs.fess.ds.impl.GitBucketDataStoreImpl.crawlFileContents(GitBucketDataStoreImpl.java:447) [classes/:?]\r\n        at org.codelibs.fess.ds.impl.GitBucketDataStoreImpl.crawlFileContents(GitBucketDataStoreImpl.java:447) [classes/:?]\r\n        at org.codelibs.fess.ds.impl.GitBucketDataStoreImpl.storeData(GitBucketDataStoreImpl.java:124) [classes/:?]\r\n        at org.codelibs.fess.ds.impl.AbstractDataStoreImpl.store(AbstractDataStoreImpl.java:106) [classes/:?]\r\n        at org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.process(DataIndexHelper.java:236) [classes/:?]\r\n        at org.codelibs.fess.helper.DataIndexHelper$DataCrawlingThread.run(DataIndexHelper.java:222) [classes/:?]\r\nCaused by: org.codelibs.fess.crawler.exception.MultipleCrawlingAccessException: \r\nFailed to access to http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/hoge?ref=b7d5e8b5fba9a7927ff2b5106066e790ad2ced4e&large_file=true; \r\nConnection time out(Connect to gitbucket:8080 [gitbucket/IP] failed: Connection refused (Connection refused)):\r\n http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/hoge?ref=b7d5e8b5fba9a7927ff2b5106066e790ad2ced4e&large_file=true; \r\n Connection time out(Connect to gitbucket:8080 [gitbucket/IP] failed: Connection refused (Connection refused)): \r\n http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/hoge?ref=b7d5e8b5fba9a7927ff2b5106066e790ad2ced4e&large_file=true; \r\n Connection time out(Connect to gitbucket:8080 [gitbucket/IP] failed: Connection refused (Connection refused)): \r\n http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/hoge?ref=b7d5e8b5fba9a7927ff2b5106066e790ad2ced4e&large_file=true;\r\n Connection time out(Connect to gitbucket:8080 [gitbucket/IP] failed: Connection refused (Connection refused)): \r\n http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/hoge?ref=b7d5e8b5fba9a7927ff2b5106066e790ad2ced4e&large_file=true; \r\n Connection time out(Connect to gitbucket:8080 [gitbucket/IP] failed: Connection refused (Connection refused)): \r\n http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/hoge?ref=b7d5e8b5fba9a7927ff2b5106066e790ad2ced4e&large_file=true\r\n        at org.codelibs.fess.crawler.client.FaultTolerantClient.execute(FaultTolerantClient.java:95) ~[fess-crawler-2.0.1.jar:?]\r\n        at org.codelibs.fess.helper.DocumentHelper.processRequest(DocumentHelper.java:148) ~[classes/:?]\r\n        ... 9 more\r\n\r\n# issue crawl log\r\n2018-02-13 18:43:02,794 [5DFNjmEBO7Desvq7XhyO-1] INFO  Get a content from http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/issues/17\r\n```\r\n\r\nOn Linux, both requests seem to return the same result.\r\n\r\n```\r\n# file request\r\ncurl http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/contents/README.md\r\n{\"message\":\"Requires authentication\"}\r\n# issue request\r\ncurl http://gitbucket:8080/gitbucket/api/v3/repos/name/repo/issues/21\r\n{\"message\":\"Requires authentication\"}\r\n``` \r\n\r\nI think that it may be a problem in setting proxy. (Proxy discards file request)\r\nI would like to know about the http request of the file crawl API.\r\n\r\nthanks."}}
{"actor":{"display_login":"sho-suzuki"}}