{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/22521","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/22521/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/22521/comments","events_url":"https://api.github.com/repos/apache/spark/issues/22521/events","html_url":"https://github.com/apache/spark/pull/22521","id":362710452,"node_id":"MDExOlB1bGxSZXF1ZXN0MjE3MzUyMjA3","number":22521,"title":"[SPARK-24519][CORE] Compute SHUFFLE_MIN_NUM_PARTS_TO_HIGHLY_COMPRESS only once","user":{"login":"rxin","id":323388,"node_id":"MDQ6VXNlcjMyMzM4OA==","avatar_url":"https://avatars0.githubusercontent.com/u/323388?v=4","gravatar_id":"","url":"https://api.github.com/users/rxin","html_url":"https://github.com/rxin","followers_url":"https://api.github.com/users/rxin/followers","following_url":"https://api.github.com/users/rxin/following{/other_user}","gists_url":"https://api.github.com/users/rxin/gists{/gist_id}","starred_url":"https://api.github.com/users/rxin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rxin/subscriptions","organizations_url":"https://api.github.com/users/rxin/orgs","repos_url":"https://api.github.com/users/rxin/repos","events_url":"https://api.github.com/users/rxin/events{/privacy}","received_events_url":"https://api.github.com/users/rxin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":21,"created_at":"2018-09-21T17:33:12Z","updated_at":"2018-09-26T00:53:10Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/22521","html_url":"https://github.com/apache/spark/pull/22521","diff_url":"https://github.com/apache/spark/pull/22521.diff","patch_url":"https://github.com/apache/spark/pull/22521.patch"},"body":"## What changes were proposed in this pull request?\r\nPreviously SPARK-24519 created a modifiable config SHUFFLE_MIN_NUM_PARTS_TO_HIGHLY_COMPRESS. However, the config is being parsed for every creation of MapStatus, which could be very expensive. Another problem with the previous approach is that it created the illusion that this can be changed dynamically at runtime, which was not true. This PR changes it so the config is computed only once.\r\n\r\n## How was this patch tested?\r\nRemoved a test case that's no longer valid.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/424548855","html_url":"https://github.com/apache/spark/pull/22521#issuecomment-424548855","issue_url":"https://api.github.com/repos/apache/spark/issues/22521","id":424548855,"node_id":"MDEyOklzc3VlQ29tbWVudDQyNDU0ODg1NQ==","user":{"login":"SparkQA","id":8108735,"node_id":"MDQ6VXNlcjgxMDg3MzU=","avatar_url":"https://avatars1.githubusercontent.com/u/8108735?v=4","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2018-09-26T00:53:10Z","updated_at":"2018-09-26T00:53:10Z","author_association":"NONE","body":"**[Test build #96585 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/96585/testReport)** for PR 22521 at commit [`4af98e7`](https://github.com/apache/spark/commit/4af98e76319cbb363b5646f3cde85a3eca12a6ef)."}}
{"actor":{"display_login":"SparkQA"}}