{"action":"created","issue":{"url":"https://api.github.com/repos/rstudio/sparklyr/issues/263","repository_url":"https://api.github.com/repos/rstudio/sparklyr","labels_url":"https://api.github.com/repos/rstudio/sparklyr/issues/263/labels{/name}","comments_url":"https://api.github.com/repos/rstudio/sparklyr/issues/263/comments","events_url":"https://api.github.com/repos/rstudio/sparklyr/issues/263/events","html_url":"https://github.com/rstudio/sparklyr/issues/263","id":182556547,"number":263,"title":"Failure to connect on Windows R 3.3.1","user":{"login":"trinker","id":1763278,"avatar_url":"https://avatars.githubusercontent.com/u/1763278?v=3","gravatar_id":"","url":"https://api.github.com/users/trinker","html_url":"https://github.com/trinker","followers_url":"https://api.github.com/users/trinker/followers","following_url":"https://api.github.com/users/trinker/following{/other_user}","gists_url":"https://api.github.com/users/trinker/gists{/gist_id}","starred_url":"https://api.github.com/users/trinker/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/trinker/subscriptions","organizations_url":"https://api.github.com/users/trinker/orgs","repos_url":"https://api.github.com/users/trinker/repos","events_url":"https://api.github.com/users/trinker/events{/privacy}","received_events_url":"https://api.github.com/users/trinker/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":30,"created_at":"2016-10-12T15:27:37Z","updated_at":"2016-10-20T20:40:12Z","closed_at":null,"body":"I am having a problem with the latest version (0.4.15) of sparklyr connecting.  I had the same issue with spark 1.6.2.  Here is the error logs for the two attempts to connect + `sessionInfo`:\r\n\r\n## Attempt 1: Defaults\r\n\r\n```\r\n> library(sparklyr)\r\n> sc <- spark_connect(master = \"local\")\r\nError in force(code) : \r\n  Failed while connecting to sparklyr to port (8880) for sessionid (8911): Gateway in port (8880) did not respond.\r\n    Path: C:\\Users\\trinker\\AppData\\Local\\rstudio\\spark\\Cache\\spark-2.0.1-bin-hadoop2.7\\bin\\spark-submit2.cmd\r\n    Parameters: --class, sparklyr.Backend, --packages, \"com.databricks:spark-csv_2.11:1.3.0\", \"C:\\R\\R-3.3.1\\library\\sparklyr\\java\\sparklyr-2.0-2.11.jar\", 8880, 8911\r\n    Traceback:\r\n      shell_connection(master = master, spark_home = spark_home, app_name = app_name, version = version, hadoop_version = hadoop_version, shell_args = shell_args, config = config, service = FALSE, extensions = extensions)\r\n      start_shell(master = master, spark_home = spark_home, spark_version = version, app_name = app_name, config = config, jars = spark_config_value(config, \"spark.jars.default\", list()), packages = spark_config_value(config, \"sparklyr.defaultPackages\"), extensions = extensions, environment = environment, shell_args = shell_args, service = service)\r\n      tryCatch({\r\n    gatewayInfo <- spark_connect_gateway(gatewayAddress, gatewayPort, sessionId, config = config, isStarting = TRUE)\r\n}, error = function(e) {\r\n    abort_shell(paste(\"Failed while connecting to sparklyr to port (\", gatewayPort, \") for sessionid (\", sessionId, \"): \", e$message, sep = \"\"), spark_submit_path, shell_args, output_file, error_file)\r\n})\r\n      tryCatchList(expr, classes, parentenv, handlers)\r\n      tryCatchOne(expr, names, parentenv, handlers[[1]])\r\n      value[[3]](cond)\r\n      abort_shell(paste(\"Failed while connecting to sparklyr to port (\", gatewayPort, \") for sessionid (\", sessionId, \"): \", e$message, sep = \"\"), spark_submit_path, shell_args, output_file, error_file)\r\n\r\n---- Output Log ----\r\n\r\n\r\n---- Error Log ----\r\nIn addition: Warning message:\r\nrunning command '\"C:\\Users\\trinker\\AppData\\Local\\rstudio\\spark\\Cache\\spark-2.0.1-bin-hadoop2.7\\bin\\spark-submit2.cmd\" --class sparklyr.Backend --packages \"com.databricks:spark-csv_2.11:1.3.0\" \"C:\\R\\R-3.3.1\\library\\sparklyr\\java\\sparklyr-2.0-2.11.jar\" 8880 8911' had status 127 \r\n```\r\n\r\n## Attempt 2: Manually set Config\r\n\r\n```\r\n> config <- spark_config()\r\n> config[[\"sparklyr.defaultPackages\"]] <- NULL\r\n> sc <- spark_connect(master = \"local\", config = config)\r\nError in force(code) : \r\n  Failed while connecting to sparklyr to port (8880) for sessionid (7491): Gateway in port (8880) did not respond.\r\n    Path: C:\\Users\\trinker\\AppData\\Local\\rstudio\\spark\\Cache\\spark-2.0.1-bin-hadoop2.7\\bin\\spark-submit2.cmd\r\n    Parameters: --class, sparklyr.Backend, \"C:\\R\\R-3.3.1\\library\\sparklyr\\java\\sparklyr-2.0-2.11.jar\", 8880, 7491\r\n    Traceback:\r\n      shell_connection(master = master, spark_home = spark_home, app_name = app_name, version = version, hadoop_version = hadoop_version, shell_args = shell_args, config = config, service = FALSE, extensions = extensions)\r\n      start_shell(master = master, spark_home = spark_home, spark_version = version, app_name = app_name, config = config, jars = spark_config_value(config, \"spark.jars.default\", list()), packages = spark_config_value(config, \"sparklyr.defaultPackages\"), extensions = extensions, environment = environment, shell_args = shell_args, service = service)\r\n      tryCatch({\r\n    gatewayInfo <- spark_connect_gateway(gatewayAddress, gatewayPort, sessionId, config = config, isStarting = TRUE)\r\n}, error = function(e) {\r\n    abort_shell(paste(\"Failed while connecting to sparklyr to port (\", gatewayPort, \") for sessionid (\", sessionId, \"): \", e$message, sep = \"\"), spark_submit_path, shell_args, output_file, error_file)\r\n})\r\n      tryCatchList(expr, classes, parentenv, handlers)\r\n      tryCatchOne(expr, names, parentenv, handlers[[1]])\r\n      value[[3]](cond)\r\n      abort_shell(paste(\"Failed while connecting to sparklyr to port (\", gatewayPort, \") for sessionid (\", sessionId, \"): \", e$message, sep = \"\"), spark_submit_path, shell_args, output_file, error_file)\r\n\r\n---- Output Log ----\r\n\r\n\r\n---- Error Log ----\r\nIn addition: Warning message:\r\nrunning command '\"C:\\Users\\trinker\\AppData\\Local\\rstudio\\spark\\Cache\\spark-2.0.1-bin-hadoop2.7\\bin\\spark-submit2.cmd\" --class sparklyr.Backend \"C:\\R\\R-3.3.1\\library\\sparklyr\\java\\sparklyr-2.0-2.11.jar\" 8880 7491' had status 127 \r\n```\r\n\r\n## Session Info\r\n\r\n```\r\n> sessionInfo()\r\nR version 3.3.1 (2016-06-21)\r\nPlatform: x86_64-w64-mingw32/x64 (64-bit)\r\nRunning under: Windows >= 8 x64 (build 9200)\r\n\r\nlocale:\r\n[1] LC_COLLATE=English_United States.1252  LC_CTYPE=English_United States.1252    LC_MONETARY=English_United States.1252\r\n[4] LC_NUMERIC=C                           LC_TIME=English_United States.1252    \r\n\r\nattached base packages:\r\n[1] stats     graphics  grDevices utils     datasets  methods   base     \r\n\r\nother attached packages:\r\n[1] sparklyr_0.4.15\r\n\r\nloaded via a namespace (and not attached):\r\n [1] magrittr_1.5    R6_2.1.3        assertthat_0.1  rprojroot_1.0-2 rsconnect_0.4.3 parallel_3.3.1  DBI_0.5-1       tools_3.3.1     withr_1.0.2    \r\n[10] dplyr_0.5.0     rappdirs_0.3.1  yaml_2.1.13     tibble_1.2      Rcpp_0.12.7     config_0.2      digest_0.6.10  \r\n> \r\n```"},"comment":{"url":"https://api.github.com/repos/rstudio/sparklyr/issues/comments/255221754","html_url":"https://github.com/rstudio/sparklyr/issues/263#issuecomment-255221754","issue_url":"https://api.github.com/repos/rstudio/sparklyr/issues/263","id":255221754,"user":{"login":"javierluraschi","id":3478847,"avatar_url":"https://avatars.githubusercontent.com/u/3478847?v=3","gravatar_id":"","url":"https://api.github.com/users/javierluraschi","html_url":"https://github.com/javierluraschi","followers_url":"https://api.github.com/users/javierluraschi/followers","following_url":"https://api.github.com/users/javierluraschi/following{/other_user}","gists_url":"https://api.github.com/users/javierluraschi/gists{/gist_id}","starred_url":"https://api.github.com/users/javierluraschi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/javierluraschi/subscriptions","organizations_url":"https://api.github.com/users/javierluraschi/orgs","repos_url":"https://api.github.com/users/javierluraschi/repos","events_url":"https://api.github.com/users/javierluraschi/events{/privacy}","received_events_url":"https://api.github.com/users/javierluraschi/received_events","type":"User","site_admin":false},"created_at":"2016-10-20T20:40:12Z","updated_at":"2016-10-20T20:40:12Z","body":"Thank you @kevinushey, @trinker @yarrick19 could you get sparklyr `0.4.18` and run `spark_uninstall` with the right version followed by `spark_install` and retry connecting?"}}
{"actor":{"display_login":"javierluraschi"}}