{"action":"created","issue":{"url":"https://api.github.com/repos/ActianCorp/spark-vector/issues/28","repository_url":"https://api.github.com/repos/ActianCorp/spark-vector","labels_url":"https://api.github.com/repos/ActianCorp/spark-vector/issues/28/labels{/name}","comments_url":"https://api.github.com/repos/ActianCorp/spark-vector/issues/28/comments","events_url":"https://api.github.com/repos/ActianCorp/spark-vector/issues/28/events","html_url":"https://github.com/ActianCorp/spark-vector/issues/28","id":154009293,"number":28,"title":"QA - SPARK CONNECTOR - errors on connection closing","user":{"login":"Pyrobal","id":17494198,"avatar_url":"https://avatars.githubusercontent.com/u/17494198?v=3","gravatar_id":"","url":"https://api.github.com/users/Pyrobal","html_url":"https://github.com/Pyrobal","followers_url":"https://api.github.com/users/Pyrobal/followers","following_url":"https://api.github.com/users/Pyrobal/following{/other_user}","gists_url":"https://api.github.com/users/Pyrobal/gists{/gist_id}","starred_url":"https://api.github.com/users/Pyrobal/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Pyrobal/subscriptions","organizations_url":"https://api.github.com/users/Pyrobal/orgs","repos_url":"https://api.github.com/users/Pyrobal/repos","events_url":"https://api.github.com/users/Pyrobal/events{/privacy}","received_events_url":"https://api.github.com/users/Pyrobal/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/ActianCorp/spark-vector/labels/bug","name":"bug","color":"fc2929"}],"state":"closed","locked":false,"assignee":{"login":"cbarca","id":1218881,"avatar_url":"https://avatars.githubusercontent.com/u/1218881?v=3","gravatar_id":"","url":"https://api.github.com/users/cbarca","html_url":"https://github.com/cbarca","followers_url":"https://api.github.com/users/cbarca/followers","following_url":"https://api.github.com/users/cbarca/following{/other_user}","gists_url":"https://api.github.com/users/cbarca/gists{/gist_id}","starred_url":"https://api.github.com/users/cbarca/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cbarca/subscriptions","organizations_url":"https://api.github.com/users/cbarca/orgs","repos_url":"https://api.github.com/users/cbarca/repos","events_url":"https://api.github.com/users/cbarca/events{/privacy}","received_events_url":"https://api.github.com/users/cbarca/received_events","type":"User","site_admin":false},"milestone":null,"comments":2,"created_at":"2016-05-10T13:41:43Z","updated_at":"2016-05-11T12:52:27Z","closed_at":"2016-05-11T12:52:27Z","body":"latest jar provided by Cristi shows new errors after the unload finished.\r\n\r\nby Andrei:\r\n\"I think we try to close the connection and it was already closed\"\r\n\r\n\r\n      scala> sqlContext.sql(\"select * from tab_VARCHAR1\").write.format(\"com.databr\r\nicks.spark.csv\").save(s\"$savepath/tab_VARCHAR1.csv\")\r\n      \r\n[Stage 2:==========> (3 + 4)\r\n/ 16]\r\n[Stage 2:=====================> (6 + 4) /\r\n16]\r\n[Stage 2:=============================> (8 + 4) /\r\n16]\r\n[Stage 2:=======================================> (11 + 2) / 1\r\n6]\r\n[Stage 2:==========================================> (12 + 2) / 16\r\n]\r\n[Stage 2:=================================================> (14 + 2) / 16]\r\n\r\n[Stage 2:=====================================================> (15 + 1) / 16]\r\n                                                                                \r\n1\r\n6/05/10 13:40:12 ERROR LiveListenerBus: Listener anonfununloadVector1anon1 threw an exception\r\n      java.sql.SQLNonTransientConnectionException: Connection closed.\r\n      at com.ingres.gcf.util.SqlExType.getSqlEx(SqlExType.java:97)\r\n      at com.ingres.gcf.util.SqlExFactory.get(SqlExFactory.java:68)\r\n      at com.ingres.gcf.jdbc.JdbcConn.check(JdbcConn.java:1663)\r\n      at com.ingres.gcf.jdbc.JdbcConn.commit(JdbcConn.java:3162)\r\n      at com.actian.spark_vector.vector.VectorJDBC.commit(VectorJDBC.scala:207)\r\n      at com.actian.spark_vector.datastream.DataStreamClient.commit(DataStreamClient.scala:83)\r\n      at com.actian.spark_vector.vector.Vector$$anonfun$unloadVector$1$$anon$1.onJobEnd(Vector.scala:130)\r\n      at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:36)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:56)\r\n      at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.apply$mcV$sp(AsynchronousListenerBus.scala:79)\r\n      at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1135)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)\r\n      16/05/10 13:40:12 ERROR LiveListenerBus: Listener anonfununloadVector1anon1threw an exception\r\n      java.sql.SQLNonTransientConnectionException: Connection closed.\r\n      at com.ingres.gcf.util.SqlExType.getSqlEx(SqlExType.java:97)\r\n      at com.ingres.gcf.util.SqlExFactory.get(SqlExFactory.java:68)\r\n      at com.ingres.gcf.jdbc.JdbcConn.check(JdbcConn.java:1663)\r\n      at com.ingres.gcf.jdbc.JdbcConn.commit(JdbcConn.java:3162)\r\n      at com.actian.spark_vector.vector.VectorJDBC.commit(VectorJDBC.scala:207)\r\n      at com.actian.spark_vector.datastream.DataStreamClient.commit(DataStreamClient.scala:83)\r\n      at com.actian.spark_vector.vector.Vector$$anonfun$unloadVector$1$$anon$1.onJobEnd(Vector.scala:130)\r\n      at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:36)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:56)\r\n      at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.app\r\nly$mcV$sp(AsynchronousListenerBus.scala:79)\r\n      at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1135)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)\r\n\r\n      scala>\r\n\r\n      scala> sqlContext.sql(s\"\"\"CREATE TEMPORARY TABLE tab_VARCHAR20\r\n           | USING com.actian.spark_vector.sql.DefaultSource\r\n           | OPTIONS (\r\n           | host \"$hostname\",\r\n           | instance \"$installation_ID\",\r\n           | database \"$databasename\",\r\n           | table \"tab_VARCHAR20\",\r\n           | user \"actian\",\r\n           | password \"actian\")\"\"\")\r\n      res6: org.apache.spark.sql.DataFrame = []\r\n\r\n      scala>\r\n\r\n      scala> sqlContext.sql(\"select * from tab_VARCHAR20\").write.format(\"com.datab\r\nricks.spark.csv\").save(s\"$savepath/tab_VARCHAR20.csv\")\r\n      \r\n[Stage 3:==============> (4 + 4)\r\n/ 16]\r\n[Stage 3:=====================> (6 + 4) /\r\n16]\r\n[Stage 3:===================================> (10 + 4) /\r\n16]\r\n[Stage 3:==========================================> (12 + 2) / 1\r\n6]\r\n[Stage 3:==============================================> (13 + 2) / 16\r\n]\r\n[Stage 3:=================================================> (14 + 2) / 16]\r\n\r\n[Stage 3:=====================================================> (15 + 1) / 16]\r\n                                                                                \r\n1\r\n6/05/10 13:40:16 ERROR LiveListenerBus: Listener anonfununloadVector1anon1 threw a\r\nn exception\r\n      java.sql.SQLNonTransientConnectionException: Connection closed.\r\n      at com.ingres.gcf.util.SqlExType.getSqlEx(SqlExType.java:97)\r\n      at com.ingres.gcf.util.SqlExFactory.get(SqlExFactory.java:68)\r\n      at com.ingres.gcf.jdbc.JdbcConn.check(JdbcConn.java:1663)\r\n      at com.ingres.gcf.jdbc.JdbcConn.commit(JdbcConn.java:3162)\r\n      at com.actian.spark_vector.vector.VectorJDBC.commit(VectorJDBC.scala:207)\r\n      at com.actian.spark_vector.datastream.DataStreamClient.commit(DataStreamClient.scala:83)\r\n      at com.actian.spark_vector.vector.Vector$$anonfun$unloadVector$1$$anon$1.onJobEnd(Vector.scala:130)\r\n      at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:36)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:56)\r\n      at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.app\r\nly$mcV$sp(AsynchronousListenerBus.scala:79)\r\n      at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1135)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)\r\n      16/05/10 13:40:16 ERROR LiveListenerBus: Listener anonfununloadVector1anon1threw an exception\r\n      java.sql.SQLNonTransientConnectionException: Connection closed.\r\n      at com.ingres.gcf.util.SqlExType.getSqlEx(SqlExType.java:97)\r\n      at com.ingres.gcf.util.SqlExFactory.get(SqlExFactory.java:68)\r\n      at com.ingres.gcf.jdbc.JdbcConn.check(JdbcConn.java:1663)\r\n      at com.ingres.gcf.jdbc.JdbcConn.commit(JdbcConn.java:3162)\r\n      at com.actian.spark_vector.vector.VectorJDBC.commit(VectorJDBC.scala:207)\r\n      at com.actian.spark_vector.datastream.DataStreamClient.commit(DataStreamClient.scala:83)\r\n      at com.actian.spark_vector.vector.Vector$$anonfun$unloadVector$1$$anon$1.onJobEnd(Vector.scala:130)\r\n      at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:36)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:56)\r\n      at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.app\r\nly$mcV$sp(AsynchronousListenerBus.scala:79)\r\n      at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1135)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)\r\n      16/05/10 13:40:16 ERROR LiveListenerBus: Listener anonfununloadVector1anon1threw an exception\r\n      java.sql.SQLNonTransientConnectionException: Connection closed.\r\n      at com.ingres.gcf.util.SqlExType.getSqlEx(SqlExType.java:97)\r\n      at com.ingres.gcf.util.SqlExFactory.get(SqlExFactory.java:68)\r\n      at com.ingres.gcf.jdbc.JdbcConn.check(JdbcConn.java:1663)\r\n      at com.ingres.gcf.jdbc.JdbcConn.commit(JdbcConn.java:3162)\r\n      at com.actian.spark_vector.vector.VectorJDBC.commit(VectorJDBC.scala:207)\r\n      at com.actian.spark_vector.datastream.DataStreamClient.commit(DataStreamClient.scala:83)\r\n      at com.actian.spark_vector.vector.Vector$$anonfun$unloadVector$1$$anon$1.onJobEnd(Vector.scala:130)\r\n      at org.apache.spark.scheduler.SparkListenerBus$class.onPostEvent(SparkListenerBus.scala:36)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.scheduler.LiveListenerBus.onPostEvent(LiveListenerBus.scala:31)\r\n      at org.apache.spark.util.ListenerBus$class.postToAll(ListenerBus.scala:56)\r\n      at org.apache.spark.util.AsynchronousListenerBus.postToAll(AsynchronousListenerBus.scala:37)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1$$anonfun$run$1.app\r\nly$mcV$sp(AsynchronousListenerBus.scala:79)\r\n      at org.apache.spark.util.Utils$.tryOrStopSparkContext(Utils.scala:1135)\r\n      at org.apache.spark.util.AsynchronousListenerBus$$anon$1.run(AsynchronousListenerBus.scala:63)\r\n\r\n      scala>\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/ActianCorp/spark-vector/issues/comments/218449834","html_url":"https://github.com/ActianCorp/spark-vector/issues/28#issuecomment-218449834","issue_url":"https://api.github.com/repos/ActianCorp/spark-vector/issues/28","id":218449834,"user":{"login":"cbarca","id":1218881,"avatar_url":"https://avatars.githubusercontent.com/u/1218881?v=3","gravatar_id":"","url":"https://api.github.com/users/cbarca","html_url":"https://github.com/cbarca","followers_url":"https://api.github.com/users/cbarca/followers","following_url":"https://api.github.com/users/cbarca/following{/other_user}","gists_url":"https://api.github.com/users/cbarca/gists{/gist_id}","starred_url":"https://api.github.com/users/cbarca/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cbarca/subscriptions","organizations_url":"https://api.github.com/users/cbarca/orgs","repos_url":"https://api.github.com/users/cbarca/repos","events_url":"https://api.github.com/users/cbarca/events{/privacy}","received_events_url":"https://api.github.com/users/cbarca/received_events","type":"User","site_admin":false},"created_at":"2016-05-11T12:52:26Z","updated_at":"2016-05-11T12:52:26Z","body":"fixed in master too, closing"}}