{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/14080","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/14080/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/14080/comments","events_url":"https://api.github.com/repos/apache/spark/issues/14080/events","html_url":"https://github.com/apache/spark/pull/14080","id":164189401,"number":14080,"title":"[SPARK-16405] Add metrics and source for external shuffle service","user":{"login":"lovexi","id":11913695,"avatar_url":"https://avatars.githubusercontent.com/u/11913695?v=3","gravatar_id":"","url":"https://api.github.com/users/lovexi","html_url":"https://github.com/lovexi","followers_url":"https://api.github.com/users/lovexi/followers","following_url":"https://api.github.com/users/lovexi/following{/other_user}","gists_url":"https://api.github.com/users/lovexi/gists{/gist_id}","starred_url":"https://api.github.com/users/lovexi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lovexi/subscriptions","organizations_url":"https://api.github.com/users/lovexi/orgs","repos_url":"https://api.github.com/users/lovexi/repos","events_url":"https://api.github.com/users/lovexi/events{/privacy}","received_events_url":"https://api.github.com/users/lovexi/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":11,"created_at":"2016-07-06T22:28:19Z","updated_at":"2016-07-11T23:28:50Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/14080","html_url":"https://github.com/apache/spark/pull/14080","diff_url":"https://github.com/apache/spark/pull/14080.diff","patch_url":"https://github.com/apache/spark/pull/14080.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nSince externalShuffleService is essential for spark, better monitoring for shuffle service is necessary. In order to do so, we added various metrics in shuffle service and ExternalShuffleServiceSource for metric system.\r\nMetrics added in shuffle service:\r\n* registeredExecutorsSize\r\n* totalShuffleRequests\r\n* timeDelayForOpenBlockRequest\r\n* timeDelayForRegisterExecutorRequest\r\n* transferBlockRate\r\n\r\nJIRA Issue: https://issues.apache.org/jira/browse/SPARK-16405\r\n\r\n## How was this patch tested?\r\n\r\nUnit tests"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/231895658","html_url":"https://github.com/apache/spark/pull/14080#issuecomment-231895658","issue_url":"https://api.github.com/repos/apache/spark/issues/14080","id":231895658,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2016-07-11T23:28:50Z","updated_at":"2016-07-11T23:28:50Z","body":"**[Test build #3182 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3182/consoleFull)** for PR 14080 at commit [`258ed7a`](https://github.com/apache/spark/commit/258ed7a56fdc0bdce4f93de0e58e2c37b08f7e86).\n * This patch **fails Spark unit tests**.\n * This patch merges cleanly.\n * This patch adds no public classes."}}
{"actor":{"display_login":"SparkQA"}}