{"action":"created","issue":{"url":"https://api.github.com/repos/databricks/spark-redshift/issues/181","repository_url":"https://api.github.com/repos/databricks/spark-redshift","labels_url":"https://api.github.com/repos/databricks/spark-redshift/issues/181/labels{/name}","comments_url":"https://api.github.com/repos/databricks/spark-redshift/issues/181/comments","events_url":"https://api.github.com/repos/databricks/spark-redshift/issues/181/events","html_url":"https://github.com/databricks/spark-redshift/issues/181","id":135598669,"number":181,"title":"S3 Bucket does not exist error","user":{"login":"ghost","id":10137,"avatar_url":"https://avatars.githubusercontent.com/u/10137?v=3","gravatar_id":"","url":"https://api.github.com/users/ghost","html_url":"https://github.com/ghost","followers_url":"https://api.github.com/users/ghost/followers","following_url":"https://api.github.com/users/ghost/following{/other_user}","gists_url":"https://api.github.com/users/ghost/gists{/gist_id}","starred_url":"https://api.github.com/users/ghost/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ghost/subscriptions","organizations_url":"https://api.github.com/users/ghost/orgs","repos_url":"https://api.github.com/users/ghost/repos","events_url":"https://api.github.com/users/ghost/events{/privacy}","received_events_url":"https://api.github.com/users/ghost/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/databricks/spark-redshift/labels/stale%20/%20awaiting%20update","name":"stale / awaiting update","color":"fbca04"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":12,"created_at":"2016-02-23T01:31:05Z","updated_at":"2016-04-29T09:28:30Z","closed_at":"2016-03-21T19:37:07Z","body":"About 2-3 weeks ago, I was able to run spark and have it write to the exact same bucket. However when I run the spark job today, i got the following message.\r\n\r\n16/02/23 01:25:51 ERROR Utils$: The S3 bucket nysdoh.hci3.kpmg.two does not exist\r\n16/02/23 01:25:51 ERROR Utils$: The S3 bucket nysdoh.hci3.kpmg.two does not exist\r\n....\r\n16/02/23 01:25:51 ERROR ApplicationMaster: User class threw exception: java.sql.SQLException: [Amazon](500310) Invalid operation: Specified types or functions (one per INFO message) not supported on Redshift tables.;\r\njava.sql.SQLException: [Amazon](500310) Invalid operation: Specified types or functions (one per INFO message) not supported on Redshift tables.;\r\n\tat com.amazon.redshift.client.messages.inbound.ErrorResponse.toErrorException(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.handleErrorResponse(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.getOperationMetadata(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.getOperationMetadata(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.handleMessage(Unknown Source)\r\n\tat com.amazon.jdbc.communications.InboundMessagesPipeline.getNextMessageOfClass(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.doMoveToNextClass(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.getReadyForQuery(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.getOperationMetadata(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.getOperationMetadata(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.handleMessage(Unknown Source)\r\n\tat com.amazon.jdbc.communications.InboundMessagesPipeline.getNextMessageOfClass(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.doMoveToNextClass(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.getReadyForQuery(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.getOperationMetadata(Unknown Source)\r\n\tat com.amazon.redshift.client.PGMessagingContext.getOperationMetadata(Unknown Source)\r\n\tat com.amazon.redshift.dataengine.PGExecutionResults.<init>(Unknown Source)\r\n\tat com.amazon.redshift.dataengine.PGAbstractQueryExecutor.getResults(Unknown Source)\r\n\tat com.amazon.jdbc.common.SPreparedStatement.executeWithParams(Unknown Source)\r\n\tat com.amazon.jdbc.common.SPreparedStatement.execute(Unknown Source)\r\n\tat com.databricks.spark.redshift.JDBCWrapper$$anonfun$executeInterruptibly$1.apply(RedshiftJDBCWrapper.scala:122)\r\n\tat com.databricks.spark.redshift.JDBCWrapper$$anonfun$executeInterruptibly$1.apply(RedshiftJDBCWrapper.scala:122)\r\n\tat com.databricks.spark.redshift.JDBCWrapper$$anonfun$2.apply(RedshiftJDBCWrapper.scala:140)\r\n\tat scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)\r\n\tat scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\nCaused by: com.amazon.support.exceptions.ErrorException: [Amazon](500310) Invalid operation: Specified types or functions (one per INFO message) not supported on Redshift tables.;\r\n\t... 27 more\r\n16/02/23 01:25:51 INFO ApplicationMaster: Final app status: FAILED, exitCode: 15, (reason: User class threw exception: java.sql.SQLException: [Amazon](500310) Invalid operation: Specified types or functions (one per INFO message) not supported on Redshift tables.;)\r\n\r\nThank you!"},"comment":{"url":"https://api.github.com/repos/databricks/spark-redshift/issues/comments/215668107","html_url":"https://github.com/databricks/spark-redshift/issues/181#issuecomment-215668107","issue_url":"https://api.github.com/repos/databricks/spark-redshift/issues/181","id":215668107,"user":{"login":"jomach","id":4804546,"avatar_url":"https://avatars.githubusercontent.com/u/4804546?v=3","gravatar_id":"","url":"https://api.github.com/users/jomach","html_url":"https://github.com/jomach","followers_url":"https://api.github.com/users/jomach/followers","following_url":"https://api.github.com/users/jomach/following{/other_user}","gists_url":"https://api.github.com/users/jomach/gists{/gist_id}","starred_url":"https://api.github.com/users/jomach/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jomach/subscriptions","organizations_url":"https://api.github.com/users/jomach/orgs","repos_url":"https://api.github.com/users/jomach/repos","events_url":"https://api.github.com/users/jomach/events{/privacy}","received_events_url":"https://api.github.com/users/jomach/received_events","type":"User","site_admin":false},"created_at":"2016-04-29T09:28:30Z","updated_at":"2016-04-29T09:28:30Z","body":"+1"}}