{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/16272","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/16272/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/16272/comments","events_url":"https://api.github.com/repos/apache/spark/issues/16272/events","html_url":"https://github.com/apache/spark/pull/16272","id":195383838,"number":16272,"title":"[SPARK-18850][SS]Make StreamExecution and progress classes serializable","user":{"login":"zsxwing","id":1000778,"avatar_url":"https://avatars.githubusercontent.com/u/1000778?v=3","gravatar_id":"","url":"https://api.github.com/users/zsxwing","html_url":"https://github.com/zsxwing","followers_url":"https://api.github.com/users/zsxwing/followers","following_url":"https://api.github.com/users/zsxwing/following{/other_user}","gists_url":"https://api.github.com/users/zsxwing/gists{/gist_id}","starred_url":"https://api.github.com/users/zsxwing/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zsxwing/subscriptions","organizations_url":"https://api.github.com/users/zsxwing/orgs","repos_url":"https://api.github.com/users/zsxwing/repos","events_url":"https://api.github.com/users/zsxwing/events{/privacy}","received_events_url":"https://api.github.com/users/zsxwing/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":11,"created_at":"2016-12-13T22:12:57Z","updated_at":"2016-12-15T23:43:34Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/16272","html_url":"https://github.com/apache/spark/pull/16272","diff_url":"https://github.com/apache/spark/pull/16272.diff","patch_url":"https://github.com/apache/spark/pull/16272.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nThis PR adds StreamingQueryWrapper to make StreamExecution and progress classes serializable because it is too easy for it to get captured with normal usage. If StreamingQueryWrapper gets captured in a closure but no place calls its methods, it should not fail the Spark tasks. However if its methods are called, then this PR will throw a better message.\r\n\r\n## How was this patch tested?\r\n\r\n`test(\"StreamingQuery should be Serializable but cannot be used in executors\")`\r\n`test(\"progress classes should be Serializable\")`"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/267477723","html_url":"https://github.com/apache/spark/pull/16272#issuecomment-267477723","issue_url":"https://api.github.com/repos/apache/spark/issues/16272","id":267477723,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2016-12-15T23:43:34Z","updated_at":"2016-12-15T23:43:34Z","body":"Test FAILed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70213/\nTest FAILed."}}
{"actor":{"display_login":"AmplabJenkins"}}