{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/14225","repository_url":"https://api.github.com/repos/apache/spark","labels_url":"https://api.github.com/repos/apache/spark/issues/14225/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/14225/comments","events_url":"https://api.github.com/repos/apache/spark/issues/14225/events","html_url":"https://github.com/apache/spark/pull/14225","id":165883069,"number":14225,"title":"[WIP][SPARK-16334] Maintain single dictionary per row-batch in vectorized parquet reader","user":{"login":"sameeragarwal","id":166454,"avatar_url":"https://avatars.githubusercontent.com/u/166454?v=3","gravatar_id":"","url":"https://api.github.com/users/sameeragarwal","html_url":"https://github.com/sameeragarwal","followers_url":"https://api.github.com/users/sameeragarwal/followers","following_url":"https://api.github.com/users/sameeragarwal/following{/other_user}","gists_url":"https://api.github.com/users/sameeragarwal/gists{/gist_id}","starred_url":"https://api.github.com/users/sameeragarwal/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sameeragarwal/subscriptions","organizations_url":"https://api.github.com/users/sameeragarwal/orgs","repos_url":"https://api.github.com/users/sameeragarwal/repos","events_url":"https://api.github.com/users/sameeragarwal/events{/privacy}","received_events_url":"https://api.github.com/users/sameeragarwal/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":3,"created_at":"2016-07-15T21:40:21Z","updated_at":"2016-07-15T23:38:39Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/14225","html_url":"https://github.com/apache/spark/pull/14225","diff_url":"https://github.com/apache/spark/pull/14225.diff","patch_url":"https://github.com/apache/spark/pull/14225.patch"},"body":"## What changes were proposed in this pull request?\r\n\r\nAs part of the bugfix in https://github.com/apache/spark/pull/12279, if a row batch consist of both dictionary encoded and non-dictionary encoded pages, we explicitly decode the dictionary for the values that are already dictionary encoded. Currently we reset the dictionary while reading every page that can potentially cause ` java.lang.ArrayIndexOutOfBoundsException` while decoding older pages. This patch fixes the problem by maintaining a single dictionary per row-batch in vectorized parquet reader.\r\n\r\n## How was this patch tested?\r\n\r\nWIP"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/233093020","html_url":"https://github.com/apache/spark/pull/14225#issuecomment-233093020","issue_url":"https://api.github.com/repos/apache/spark/issues/14225","id":233093020,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2016-07-15T23:38:38Z","updated_at":"2016-07-15T23:38:38Z","body":"Merged build finished. Test PASSed."}}
{"actor":{"display_login":"AmplabJenkins"}}