{"action":"created","issue":{"url":"https://api.github.com/repos/OpenGrok/OpenGrok/issues/1116","repository_url":"https://api.github.com/repos/OpenGrok/OpenGrok","labels_url":"https://api.github.com/repos/OpenGrok/OpenGrok/issues/1116/labels{/name}","comments_url":"https://api.github.com/repos/OpenGrok/OpenGrok/issues/1116/comments","events_url":"https://api.github.com/repos/OpenGrok/OpenGrok/issues/1116/events","html_url":"https://github.com/OpenGrok/OpenGrok/issues/1116","id":160870564,"number":1116,"title":"all-project search is very slow when large number of repositories are indexed","user":{"login":"rahul-chhabra","id":19187824,"avatar_url":"https://avatars.githubusercontent.com/u/19187824?v=3","gravatar_id":"","url":"https://api.github.com/users/rahul-chhabra","html_url":"https://github.com/rahul-chhabra","followers_url":"https://api.github.com/users/rahul-chhabra/followers","following_url":"https://api.github.com/users/rahul-chhabra/following{/other_user}","gists_url":"https://api.github.com/users/rahul-chhabra/gists{/gist_id}","starred_url":"https://api.github.com/users/rahul-chhabra/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rahul-chhabra/subscriptions","organizations_url":"https://api.github.com/users/rahul-chhabra/orgs","repos_url":"https://api.github.com/users/rahul-chhabra/repos","events_url":"https://api.github.com/users/rahul-chhabra/events{/privacy}","received_events_url":"https://api.github.com/users/rahul-chhabra/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/OpenGrok/OpenGrok/labels/question","name":"question","color":"cc317c"}],"state":"open","locked":false,"assignee":{"login":"vladak","id":2934284,"avatar_url":"https://avatars.githubusercontent.com/u/2934284?v=3","gravatar_id":"","url":"https://api.github.com/users/vladak","html_url":"https://github.com/vladak","followers_url":"https://api.github.com/users/vladak/followers","following_url":"https://api.github.com/users/vladak/following{/other_user}","gists_url":"https://api.github.com/users/vladak/gists{/gist_id}","starred_url":"https://api.github.com/users/vladak/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vladak/subscriptions","organizations_url":"https://api.github.com/users/vladak/orgs","repos_url":"https://api.github.com/users/vladak/repos","events_url":"https://api.github.com/users/vladak/events{/privacy}","received_events_url":"https://api.github.com/users/vladak/received_events","type":"User","site_admin":false},"assignees":[{"login":"vladak","id":2934284,"avatar_url":"https://avatars.githubusercontent.com/u/2934284?v=3","gravatar_id":"","url":"https://api.github.com/users/vladak","html_url":"https://github.com/vladak","followers_url":"https://api.github.com/users/vladak/followers","following_url":"https://api.github.com/users/vladak/following{/other_user}","gists_url":"https://api.github.com/users/vladak/gists{/gist_id}","starred_url":"https://api.github.com/users/vladak/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vladak/subscriptions","organizations_url":"https://api.github.com/users/vladak/orgs","repos_url":"https://api.github.com/users/vladak/repos","events_url":"https://api.github.com/users/vladak/events{/privacy}","received_events_url":"https://api.github.com/users/vladak/received_events","type":"User","site_admin":false}],"milestone":null,"comments":18,"created_at":"2016-06-17T11:44:52Z","updated_at":"2016-07-04T12:20:41Z","closed_at":null,"body":"Hi,\r\nThe search is very slow when large number of repositories are indexed.\r\nEvery search is taking around 15000-25000 milliseconds.\r\n\r\nThese are some details:\r\n-----------------------------------------------------------------------------------------------\r\nNumber of Repos: ~700\r\nRepos Size:\t\t11G\r\nIndex Size:\t\t2.5G\r\nTime taking to search: 15000-20000 milliseconds every search\r\nTime taken for indexing: 10 minutes\r\nOpengrok version:\topengrok-0.12.1.5\r\nTomcat version: apache-tomcat-7.0.69\r\napache-tomcat-7.0.69/conf/server.xml:\tmaxHttpHeaderSize=\"65536\"\r\n\r\n\r\nCould you please tell if there is any configuration I can change in opengrok or apache tomcat to make search faster ? \r\nPreviously it used to take 100-300 milliseconds only when number of repositories were around 50.\r\n\r\nThanks,\r\nRahul\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/OpenGrok/OpenGrok/issues/comments/230278041","html_url":"https://github.com/OpenGrok/OpenGrok/issues/1116#issuecomment-230278041","issue_url":"https://api.github.com/repos/OpenGrok/OpenGrok/issues/1116","id":230278041,"user":{"login":"vladak","id":2934284,"avatar_url":"https://avatars.githubusercontent.com/u/2934284?v=3","gravatar_id":"","url":"https://api.github.com/users/vladak","html_url":"https://github.com/vladak","followers_url":"https://api.github.com/users/vladak/followers","following_url":"https://api.github.com/users/vladak/following{/other_user}","gists_url":"https://api.github.com/users/vladak/gists{/gist_id}","starred_url":"https://api.github.com/users/vladak/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vladak/subscriptions","organizations_url":"https://api.github.com/users/vladak/orgs","repos_url":"https://api.github.com/users/vladak/repos","events_url":"https://api.github.com/users/vladak/events{/privacy}","received_events_url":"https://api.github.com/users/vladak/received_events","type":"User","site_admin":false},"created_at":"2016-07-04T12:20:41Z","updated_at":"2016-07-04T12:20:41Z","body":"http://serverfault.com/questions/43383/caching-preloading-files-on-linux-into-ram has some pieces of advice on how can the filesystem cache be populated, in particular it contains reference to the vmtouch tool which does exactly of what I proposed above - mmap()s all files in a directory and reads them in. This of course depends on how big the cache can grow. Tts documentation contains other tuning tips."}}
{"actor":{"display_login":"vladak"}}