{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/14475","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/14475/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/14475/comments","events_url":"https://api.github.com/repos/apache/spark/issues/14475/events","html_url":"https://github.com/apache/spark/pull/14475","id":169038647,"number":14475,"title":"[SPARK-16862] Configurable buffer size in `UnsafeSorterSpillReader`","user":{"login":"tejasapatil","id":3230057,"avatar_url":"https://avatars.githubusercontent.com/u/3230057?v=3","gravatar_id":"","url":"https://api.github.com/users/tejasapatil","html_url":"https://github.com/tejasapatil","followers_url":"https://api.github.com/users/tejasapatil/followers","following_url":"https://api.github.com/users/tejasapatil/following{/other_user}","gists_url":"https://api.github.com/users/tejasapatil/gists{/gist_id}","starred_url":"https://api.github.com/users/tejasapatil/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tejasapatil/subscriptions","organizations_url":"https://api.github.com/users/tejasapatil/orgs","repos_url":"https://api.github.com/users/tejasapatil/repos","events_url":"https://api.github.com/users/tejasapatil/events{/privacy}","received_events_url":"https://api.github.com/users/tejasapatil/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":7,"created_at":"2016-08-03T03:20:21Z","updated_at":"2016-08-11T17:57:40Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/14475","html_url":"https://github.com/apache/spark/pull/14475","diff_url":"https://github.com/apache/spark/pull/14475.diff","patch_url":"https://github.com/apache/spark/pull/14475.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nJira: https://issues.apache.org/jira/browse/SPARK-16862\r\n\r\n`BufferedInputStream` used in `UnsafeSorterSpillReader` uses the default 8k buffer to read data off disk. This PR makes it configurable to improve on disk reads. I have kept the default value to be same as it was before (8k) so there would not be any change in current behavior.\r\n\r\n## How was this patch tested?\r\n\r\nI am relying on the existing unit tests.\r\n\r\n## Performance\r\n\r\nAfter deploying this change to prod and setting the config to 1 mb, there was a 12% reduction in the CPU time and 19.5% reduction in CPU reservation time."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/239239745","html_url":"https://github.com/apache/spark/pull/14475#issuecomment-239239745","issue_url":"https://api.github.com/repos/apache/spark/issues/14475","id":239239745,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2016-08-11T17:57:40Z","updated_at":"2016-08-11T17:57:40Z","body":"**[Test build #63623 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63623/consoleFull)** for PR 14475 at commit [`6ce70a9`](https://github.com/apache/spark/commit/6ce70a9995287aa19a042a80c77ecdbb1f56fe4f)."}}
{"actor":{"display_login":"SparkQA"}}