{"action":"created","issue":{"url":"https://api.github.com/repos/saurfang/spark-sas7bdat/issues/37","repository_url":"https://api.github.com/repos/saurfang/spark-sas7bdat","labels_url":"https://api.github.com/repos/saurfang/spark-sas7bdat/issues/37/labels{/name}","comments_url":"https://api.github.com/repos/saurfang/spark-sas7bdat/issues/37/comments","events_url":"https://api.github.com/repos/saurfang/spark-sas7bdat/issues/37/events","html_url":"https://github.com/saurfang/spark-sas7bdat/issues/37","id":348086608,"node_id":"MDU6SXNzdWUzNDgwODY2MDg=","number":37,"title":"Incorrect date/timestamp conversions","user":{"login":"nelson2005","id":189607,"node_id":"MDQ6VXNlcjE4OTYwNw==","avatar_url":"https://avatars0.githubusercontent.com/u/189607?v=4","gravatar_id":"","url":"https://api.github.com/users/nelson2005","html_url":"https://github.com/nelson2005","followers_url":"https://api.github.com/users/nelson2005/followers","following_url":"https://api.github.com/users/nelson2005/following{/other_user}","gists_url":"https://api.github.com/users/nelson2005/gists{/gist_id}","starred_url":"https://api.github.com/users/nelson2005/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nelson2005/subscriptions","organizations_url":"https://api.github.com/users/nelson2005/orgs","repos_url":"https://api.github.com/users/nelson2005/repos","events_url":"https://api.github.com/users/nelson2005/events{/privacy}","received_events_url":"https://api.github.com/users/nelson2005/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":6,"created_at":"2018-08-06T21:22:35Z","updated_at":"2018-11-15T16:22:40Z","closed_at":null,"author_association":"NONE","body":"I'm running into [this issue](https://eilianyu.wordpress.com/2016/10/27/be-aware-of-hidden-data-errors-using-spark-sas7bdat-pacakge-to-ingest-sas-datasets-to-spark/)\r\n\r\nwhere the dates all have one day subtracted.  I'm using sas7bdat 2.0.0-s_2.11\r\n\r\nI didn't see any other mention of this issue in the github issues list.  Is anyone else running into this?\r\n\r\nFor se\r\nhttps://eilianyu.wordpress.com/2016/10/27/be-aware-of-hidden-data-errors-using-spark-sas7bdat-pacakge-to-ingest-sas-datasets-to-spark/\r\n"},"comment":{"url":"https://api.github.com/repos/saurfang/spark-sas7bdat/issues/comments/439099490","html_url":"https://github.com/saurfang/spark-sas7bdat/issues/37#issuecomment-439099490","issue_url":"https://api.github.com/repos/saurfang/spark-sas7bdat/issues/37","id":439099490,"node_id":"MDEyOklzc3VlQ29tbWVudDQzOTA5OTQ5MA==","user":{"login":"PhoenixDai","id":3335135,"node_id":"MDQ6VXNlcjMzMzUxMzU=","avatar_url":"https://avatars2.githubusercontent.com/u/3335135?v=4","gravatar_id":"","url":"https://api.github.com/users/PhoenixDai","html_url":"https://github.com/PhoenixDai","followers_url":"https://api.github.com/users/PhoenixDai/followers","following_url":"https://api.github.com/users/PhoenixDai/following{/other_user}","gists_url":"https://api.github.com/users/PhoenixDai/gists{/gist_id}","starred_url":"https://api.github.com/users/PhoenixDai/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/PhoenixDai/subscriptions","organizations_url":"https://api.github.com/users/PhoenixDai/orgs","repos_url":"https://api.github.com/users/PhoenixDai/repos","events_url":"https://api.github.com/users/PhoenixDai/events{/privacy}","received_events_url":"https://api.github.com/users/PhoenixDai/received_events","type":"User","site_admin":false},"created_at":"2018-11-15T16:22:40Z","updated_at":"2018-11-15T16:22:40Z","author_association":"NONE","body":"@nelson2005 With hint from witwall, I've figured out the following working configs:\r\n\r\n- For spark shell: `spark-shell --master=local[*] --driver-java-options=\"-Duser.timezone=UTC\"` I believe spark-submit would work in this way too. (didn't test)\r\n- For inside a program like pyspark: `.set('spark.driver.extraJavaOptions','-Duser.timezone=UTC').set('spark.executor.extraJavaOptions','-Duser.timezone=UTC')`\r\n\r\nHope this can help you."}}
{"actor":{"display_login":"PhoenixDai"}}