{"action":"created","issue":{"url":"https://api.github.com/repos/blevesearch/bleve-bench/issues/10","labels_url":"https://api.github.com/repos/blevesearch/bleve-bench/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/blevesearch/bleve-bench/issues/10/comments","events_url":"https://api.github.com/repos/blevesearch/bleve-bench/issues/10/events","html_url":"https://github.com/blevesearch/bleve-bench/pull/10","id":125839570,"number":10,"title":"bleve-blast more concurrency between wiki reader and indexers","user":{"login":"steveyen","id":30640,"avatar_url":"https://avatars.githubusercontent.com/u/30640?v=3","gravatar_id":"","url":"https://api.github.com/users/steveyen","html_url":"https://github.com/steveyen","followers_url":"https://api.github.com/users/steveyen/followers","following_url":"https://api.github.com/users/steveyen/following{/other_user}","gists_url":"https://api.github.com/users/steveyen/gists{/gist_id}","starred_url":"https://api.github.com/users/steveyen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/steveyen/subscriptions","organizations_url":"https://api.github.com/users/steveyen/orgs","repos_url":"https://api.github.com/users/steveyen/repos","events_url":"https://api.github.com/users/steveyen/events{/privacy}","received_events_url":"https://api.github.com/users/steveyen/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-01-10T19:22:34Z","updated_at":"2016-01-11T15:23:35Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/blevesearch/bleve-bench/pulls/10","html_url":"https://github.com/blevesearch/bleve-bench/pull/10","diff_url":"https://github.com/blevesearch/bleve-bench/pull/10.diff","patch_url":"https://github.com/blevesearch/bleve-bench/pull/10.patch"},"body":"Doing this as a pull-request as it \"changes the experiment\" of bleve-blast.\r\n\r\nThe hope is that by the time an indexer is ready to handle more work, this change increases the likelihood that reader input work is al queued up and ready, instead of possibly waiting for more input file reading and parsing.\r\n\r\nAn alternative idea that popped to mind (but not part of this PR) to \"just measuring indexing\" perf... would be to have input reading+parsing done synchronously, so there would be clear, accountable phases of input reading time versus indexing time.  With a clear separation of phases, we'd then only count the indexing time and throughput."},"comment":{"url":"https://api.github.com/repos/blevesearch/bleve-bench/issues/comments/170585979","html_url":"https://github.com/blevesearch/bleve-bench/pull/10#issuecomment-170585979","issue_url":"https://api.github.com/repos/blevesearch/bleve-bench/issues/10","id":170585979,"user":{"login":"mschoch","id":298143,"avatar_url":"https://avatars.githubusercontent.com/u/298143?v=3","gravatar_id":"","url":"https://api.github.com/users/mschoch","html_url":"https://github.com/mschoch","followers_url":"https://api.github.com/users/mschoch/followers","following_url":"https://api.github.com/users/mschoch/following{/other_user}","gists_url":"https://api.github.com/users/mschoch/gists{/gist_id}","starred_url":"https://api.github.com/users/mschoch/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mschoch/subscriptions","organizations_url":"https://api.github.com/users/mschoch/orgs","repos_url":"https://api.github.com/users/mschoch/repos","events_url":"https://api.github.com/users/mschoch/events{/privacy}","received_events_url":"https://api.github.com/users/mschoch/received_events","type":"User","site_admin":false},"created_at":"2016-01-11T15:23:35Z","updated_at":"2016-01-11T15:23:35Z","body":"I'm OK with this change, but I'm not sure about the larger change.  We were trying to keep this number comparable to the Lucene indexing throughput test.  It was never intended to \"just measure indexing time\" because in the real world you always have to spend some time parsing.  The Lucene tests acknowledge that real-world apps will probably always be slower because the indexing tests already have data arrange in a very easy to parse format."}}