{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/14802","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/14802/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/14802/comments","events_url":"https://api.github.com/repos/apache/spark/issues/14802/events","html_url":"https://github.com/apache/spark/pull/14802","id":173129866,"number":14802,"title":"[SPARK-17235][SQL] Support purging of old logs in MetadataLog","user":{"login":"petermaxlee","id":20197098,"avatar_url":"https://avatars.githubusercontent.com/u/20197098?v=3","gravatar_id":"","url":"https://api.github.com/users/petermaxlee","html_url":"https://github.com/petermaxlee","followers_url":"https://api.github.com/users/petermaxlee/followers","following_url":"https://api.github.com/users/petermaxlee/following{/other_user}","gists_url":"https://api.github.com/users/petermaxlee/gists{/gist_id}","starred_url":"https://api.github.com/users/petermaxlee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/petermaxlee/subscriptions","organizations_url":"https://api.github.com/users/petermaxlee/orgs","repos_url":"https://api.github.com/users/petermaxlee/repos","events_url":"https://api.github.com/users/petermaxlee/events{/privacy}","received_events_url":"https://api.github.com/users/petermaxlee/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2016-08-25T07:14:17Z","updated_at":"2016-08-26T23:03:28Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/14802","html_url":"https://github.com/apache/spark/pull/14802","diff_url":"https://github.com/apache/spark/pull/14802.diff","patch_url":"https://github.com/apache/spark/pull/14802.patch"},"body":"## What changes were proposed in this pull request?\r\nThis patch adds a purge interface to MetadataLog, and an implementation in HDFSMetadataLog. The purge function is currently unused, but I will use it to purge old execution and file source logs in follow-up patches. These changes are required in a production structured streaming job that runs for a long period of time.\r\n\r\n## How was this patch tested?\r\nAdded a unit test case in HDFSMetadataLogSuite.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/242872355","html_url":"https://github.com/apache/spark/pull/14802#issuecomment-242872355","issue_url":"https://api.github.com/repos/apache/spark/issues/14802","id":242872355,"user":{"login":"rxin","id":323388,"avatar_url":"https://avatars.githubusercontent.com/u/323388?v=3","gravatar_id":"","url":"https://api.github.com/users/rxin","html_url":"https://github.com/rxin","followers_url":"https://api.github.com/users/rxin/followers","following_url":"https://api.github.com/users/rxin/following{/other_user}","gists_url":"https://api.github.com/users/rxin/gists{/gist_id}","starred_url":"https://api.github.com/users/rxin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rxin/subscriptions","organizations_url":"https://api.github.com/users/rxin/orgs","repos_url":"https://api.github.com/users/rxin/repos","events_url":"https://api.github.com/users/rxin/events{/privacy}","received_events_url":"https://api.github.com/users/rxin/received_events","type":"User","site_admin":false},"created_at":"2016-08-26T23:03:28Z","updated_at":"2016-08-26T23:03:28Z","body":"Alright I'm going to merge this in master/2.0. \r\n\r\n@petermaxlee and @frreiss can you guys work together?\r\n"}}
{"actor":{"display_login":"rxin"}}