{"action":"created","issue":{"url":"https://api.github.com/repos/mesosphere/spark-build/issues/393","repository_url":"https://api.github.com/repos/mesosphere/spark-build","labels_url":"https://api.github.com/repos/mesosphere/spark-build/issues/393/labels{/name}","comments_url":"https://api.github.com/repos/mesosphere/spark-build/issues/393/comments","events_url":"https://api.github.com/repos/mesosphere/spark-build/issues/393/events","html_url":"https://github.com/mesosphere/spark-build/pull/393","id":351754073,"node_id":"MDExOlB1bGxSZXF1ZXN0MjA5MjY5NDMz","number":393,"title":"Add spark.mesos.containerizer=mesos to spark tests","user":{"login":"samvantran","id":4225547,"node_id":"MDQ6VXNlcjQyMjU1NDc=","avatar_url":"https://avatars3.githubusercontent.com/u/4225547?v=4","gravatar_id":"","url":"https://api.github.com/users/samvantran","html_url":"https://github.com/samvantran","followers_url":"https://api.github.com/users/samvantran/followers","following_url":"https://api.github.com/users/samvantran/following{/other_user}","gists_url":"https://api.github.com/users/samvantran/gists{/gist_id}","starred_url":"https://api.github.com/users/samvantran/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/samvantran/subscriptions","organizations_url":"https://api.github.com/users/samvantran/orgs","repos_url":"https://api.github.com/users/samvantran/repos","events_url":"https://api.github.com/users/samvantran/events{/privacy}","received_events_url":"https://api.github.com/users/samvantran/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2018-08-17T22:14:17Z","updated_at":"2018-08-19T17:41:48Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/mesosphere/spark-build/pulls/393","html_url":"https://github.com/mesosphere/spark-build/pull/393","diff_url":"https://github.com/mesosphere/spark-build/pull/393.diff","patch_url":"https://github.com/mesosphere/spark-build/pull/393.patch"},"body":"Resolves [DCOS-40592](https://jira.mesosphere.com/browse/DCOS-40592)\r\n\r\nNow that we have statsD built into the container, we need UCR otherwise we get a bunch of these exceptions: \r\n\r\n```\r\nspark-env: Skipping metrics configuration: STATSD_UDP_HOST/STATSD_UDP_PORT are not defined\r\n[07:40:53][Step 7/8] Exception in thread \"main\" java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;\r\n[07:40:53][Step 7/8] \tat org.apache.spark.util.Utils$.getDefaultPropertiesFile(Utils.scala:2097)\r\n[07:40:53][Step 7/8] \tat org.apache.spark.deploy.SparkSubmitArguments$$anonfun$mergeDefaultSparkProperties$1.apply(SparkSubmitArguments.scala:124)\r\n[07:40:53][Step 7/8] \tat org.apache.spark.deploy.SparkSubmitArguments$$anonfun$mergeDefaultSparkProperties$1.apply(SparkSubmitArguments.scala:124)\r\n[07:40:53][Step 7/8] \tat scala.Option.getOrElse(Option.scala:120)\r\n[07:40:53][Step 7/8] \tat org.apache.spark.deploy.SparkSubmitArguments.mergeDefaultSparkProperties(SparkSubmitArguments.scala:124)\r\n[07:40:53][Step 7/8] \tat org.apache.spark.deploy.SparkSubmitArguments.<init>(SparkSubmitArguments.scala:110)\r\n[07:40:53][Step 7/8] \tat org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:114)\r\n[07:40:53][Step 7/8] \tat org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)\r\n[07:40:53][Step 7/8] I0817 07:38:09.268573 32547 executor.cpp:736] Container exited with status 1\r\n```"},"comment":{"url":"https://api.github.com/repos/mesosphere/spark-build/issues/comments/414143381","html_url":"https://github.com/mesosphere/spark-build/pull/393#issuecomment-414143381","issue_url":"https://api.github.com/repos/mesosphere/spark-build/issues/393","id":414143381,"node_id":"MDEyOklzc3VlQ29tbWVudDQxNDE0MzM4MQ==","user":{"login":"susanxhuynh","id":22622418,"node_id":"MDQ6VXNlcjIyNjIyNDE4","avatar_url":"https://avatars1.githubusercontent.com/u/22622418?v=4","gravatar_id":"","url":"https://api.github.com/users/susanxhuynh","html_url":"https://github.com/susanxhuynh","followers_url":"https://api.github.com/users/susanxhuynh/followers","following_url":"https://api.github.com/users/susanxhuynh/following{/other_user}","gists_url":"https://api.github.com/users/susanxhuynh/gists{/gist_id}","starred_url":"https://api.github.com/users/susanxhuynh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/susanxhuynh/subscriptions","organizations_url":"https://api.github.com/users/susanxhuynh/orgs","repos_url":"https://api.github.com/users/susanxhuynh/repos","events_url":"https://api.github.com/users/susanxhuynh/events{/privacy}","received_events_url":"https://api.github.com/users/susanxhuynh/received_events","type":"User","site_admin":false},"created_at":"2018-08-19T17:41:48Z","updated_at":"2018-08-19T17:41:48Z","author_association":"CONTRIBUTOR","body":"The metrics PR that was merged a while ago: https://github.com/mesosphere/spark-build/pull/290/files\r\nI'm not sure what's causing the problem: is it having the metrics.properties.template file there, or because  of the added jar? The code in spark-env.sh checks if the env vars are defined, so that part seems to working as expected. "}}
{"actor":{"display_login":"susanxhuynh"}}