{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/14270","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/14270/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/14270/comments","events_url":"https://api.github.com/repos/apache/spark/issues/14270/events","html_url":"https://github.com/apache/spark/pull/14270","id":166417667,"number":14270,"title":"[SPARK-5847][CORE] Allow for configuring MetricsSystem's use of app ID to namespace all metrics","user":{"login":"markgrover","id":1709451,"avatar_url":"https://avatars.githubusercontent.com/u/1709451?v=3","gravatar_id":"","url":"https://api.github.com/users/markgrover","html_url":"https://github.com/markgrover","followers_url":"https://api.github.com/users/markgrover/followers","following_url":"https://api.github.com/users/markgrover/following{/other_user}","gists_url":"https://api.github.com/users/markgrover/gists{/gist_id}","starred_url":"https://api.github.com/users/markgrover/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/markgrover/subscriptions","organizations_url":"https://api.github.com/users/markgrover/orgs","repos_url":"https://api.github.com/users/markgrover/repos","events_url":"https://api.github.com/users/markgrover/events{/privacy}","received_events_url":"https://api.github.com/users/markgrover/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":16,"created_at":"2016-07-19T19:47:13Z","updated_at":"2016-08-25T21:19:48Z","closed_at":"2016-07-27T17:15:19Z","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/14270","html_url":"https://github.com/apache/spark/pull/14270","diff_url":"https://github.com/apache/spark/pull/14270.diff","patch_url":"https://github.com/apache/spark/pull/14270.patch"},"body":"## What changes were proposed in this pull request?\r\nAdding a new property to SparkConf called spark.metrics.namespace that allows users to\r\nset a custom namespace for executor and driver metrics in the metrics systems.\r\n\r\nBy default, the root namespace used for driver or executor metrics is\r\nthe value of `spark.app.id`. However, often times, users want to be able to track the metrics\r\nacross apps for driver and executor metrics, which is hard to do with application ID\r\n(i.e. `spark.app.id`) since it changes with every invocation of the app. For such use cases,\r\nusers can set the `spark.metrics.namespace` property to another spark configuration key like\r\n`spark.app.name` which is then used to populate the root namespace of the metrics system\r\n(with the app name in our example). `spark.metrics.namespace` property can be set to any\r\narbitrary spark property key, whose value would be used to set the root namespace of the\r\nmetrics system. Non driver and executor metrics are never prefixed with `spark.app.id`, nor\r\ndoes the `spark.metrics.namespace` property have any such affect on such metrics.\r\n\r\n\r\n## How was this patch tested?\r\nAdded new unit tests, modified existing unit tests.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/242544160","html_url":"https://github.com/apache/spark/pull/14270#issuecomment-242544160","issue_url":"https://api.github.com/repos/apache/spark/issues/14270","id":242544160,"user":{"login":"markgrover","id":1709451,"avatar_url":"https://avatars.githubusercontent.com/u/1709451?v=3","gravatar_id":"","url":"https://api.github.com/users/markgrover","html_url":"https://github.com/markgrover","followers_url":"https://api.github.com/users/markgrover/followers","following_url":"https://api.github.com/users/markgrover/following{/other_user}","gists_url":"https://api.github.com/users/markgrover/gists{/gist_id}","starred_url":"https://api.github.com/users/markgrover/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/markgrover/subscriptions","organizations_url":"https://api.github.com/users/markgrover/orgs","repos_url":"https://api.github.com/users/markgrover/repos","events_url":"https://api.github.com/users/markgrover/events{/privacy}","received_events_url":"https://api.github.com/users/markgrover/received_events","type":"User","site_admin":false},"created_at":"2016-08-25T21:19:48Z","updated_at":"2016-08-25T21:19:48Z","body":"Sure."}}
{"actor":{"display_login":"markgrover"}}