{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/11722","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/11722/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/11722/comments","events_url":"https://api.github.com/repos/apache/spark/issues/11722/events","html_url":"https://github.com/apache/spark/pull/11722","id":140919178,"number":11722,"title":"[SPARK-13903][SQL] Modify output nullability with constraints for Join and Filter operators","user":{"login":"viirya","id":68855,"avatar_url":"https://avatars.githubusercontent.com/u/68855?v=3","gravatar_id":"","url":"https://api.github.com/users/viirya","html_url":"https://github.com/viirya","followers_url":"https://api.github.com/users/viirya/followers","following_url":"https://api.github.com/users/viirya/following{/other_user}","gists_url":"https://api.github.com/users/viirya/gists{/gist_id}","starred_url":"https://api.github.com/users/viirya/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/viirya/subscriptions","organizations_url":"https://api.github.com/users/viirya/orgs","repos_url":"https://api.github.com/users/viirya/repos","events_url":"https://api.github.com/users/viirya/events{/privacy}","received_events_url":"https://api.github.com/users/viirya/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":11,"created_at":"2016-03-15T09:26:35Z","updated_at":"2016-03-16T09:18:03Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/11722","html_url":"https://github.com/apache/spark/pull/11722","diff_url":"https://github.com/apache/spark/pull/11722.diff","patch_url":"https://github.com/apache/spark/pull/11722.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nJIRA: https://issues.apache.org/jira/browse/SPARK-13903\r\n\r\nWith constraints and optimization, we can make sure some outputs of a Join (or Filter) operator are not nulls. We should modify output nullability accordingly. We can use this information in later execution to avoid null checking.\r\n\r\nAnother reason to modify plan output is that we will use the output to determine schema. We should keep correct nullability in the schema.\r\n\r\n## How was this patch tested?\r\n\r\nModified `NullFilteringSuite`.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/197223065","html_url":"https://github.com/apache/spark/pull/11722#issuecomment-197223065","issue_url":"https://api.github.com/repos/apache/spark/issues/11722","id":197223065,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2016-03-16T09:18:03Z","updated_at":"2016-03-16T09:18:03Z","body":"Test FAILed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/53277/\nTest FAILed."}}