{"action":"created","issue":{"url":"https://api.github.com/repos/dcos-labs/dcos-jupyterlab-service/issues/17","repository_url":"https://api.github.com/repos/dcos-labs/dcos-jupyterlab-service","labels_url":"https://api.github.com/repos/dcos-labs/dcos-jupyterlab-service/issues/17/labels{/name}","comments_url":"https://api.github.com/repos/dcos-labs/dcos-jupyterlab-service/issues/17/comments","events_url":"https://api.github.com/repos/dcos-labs/dcos-jupyterlab-service/issues/17/events","html_url":"https://github.com/dcos-labs/dcos-jupyterlab-service/issues/17","id":351560983,"node_id":"MDU6SXNzdWUzNTE1NjA5ODM=","number":17,"title":"Setting storage persistent volume to enabled breaks json","user":{"login":"a-nldisr","id":1867776,"node_id":"MDQ6VXNlcjE4Njc3NzY=","avatar_url":"https://avatars2.githubusercontent.com/u/1867776?v=4","gravatar_id":"","url":"https://api.github.com/users/a-nldisr","html_url":"https://github.com/a-nldisr","followers_url":"https://api.github.com/users/a-nldisr/followers","following_url":"https://api.github.com/users/a-nldisr/following{/other_user}","gists_url":"https://api.github.com/users/a-nldisr/gists{/gist_id}","starred_url":"https://api.github.com/users/a-nldisr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/a-nldisr/subscriptions","organizations_url":"https://api.github.com/users/a-nldisr/orgs","repos_url":"https://api.github.com/users/a-nldisr/repos","events_url":"https://api.github.com/users/a-nldisr/events{/privacy}","received_events_url":"https://api.github.com/users/a-nldisr/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2018-08-17T11:37:15Z","updated_at":"2018-08-20T12:47:51Z","closed_at":"2018-08-20T08:02:04Z","author_association":"NONE","body":"Setting  persistent volume causes:\r\n```\r\nUnable to parse the string as a JSON value\r\n```\r\n\r\nChanging the value to string in JSON causes:\r\n```\r\nOptions JSON failed validation\r\n```\r\n\r\nDCOS version 1.11.x\r\n\r\nSnippet of the JSON affected:\r\n```\r\n  \"storage\": {\r\n    \"persistence\": {\r\n      \"host_volume_size\": 4000,\r\n      \"enable\": true\r\n    }\r\n  },\r\n```\r\n\r\nfull JSON\r\n```  \r\n{\r\n  \"service\": {\r\n    \"name\": \"/jupyterlab-notebook\",\r\n    \"cmd\": \"/usr/local/bin/start.sh ${CONDA_DIR}/bin/jupyter lab --notebook-dir=${MESOS_SANDBOX}\",\r\n    \"cpus\": 2,\r\n    \"force_pull\": false,\r\n    \"mem\": 8192,\r\n    \"user\": \"nobody\",\r\n    \"gpu_support\": {\r\n      \"enabled\": false,\r\n      \"gpus\": 0\r\n    }\r\n  },\r\n  \"oidc\": {\r\n    \"enable_oidc\": false,\r\n    \"oidc_discovery_uri\": \"https://keycloak.example.com/auth/realms/notebook/.well-known/openid-configuration\",\r\n    \"oidc_redirect_uri\": \"/oidc-redirect-callback\",\r\n    \"oidc_client_id\": \"notebook\",\r\n    \"oidc_client_secret\": \"b874f6e9-8f3f-41a6-a206-53e928d24fb1\",\r\n    \"oidc_tls_verify\": \"no\",\r\n    \"enable_windows\": false,\r\n    \"oidc_use_email\": false,\r\n    \"oidc_email\": \"user@example.com\",\r\n    \"oidc_upn\": \"user007\",\r\n    \"oidc_logout_path\": \"/logmeout\",\r\n    \"oidc_post_logout_redirect_uri\": \"https://<VHOST>/<optional PATH_PREFIX>/<Service Name>\",\r\n    \"oidc_use_spartan_resolver\": true\r\n  },\r\n  \"s3\": {\r\n    \"aws_region\": \"us-east-1\",\r\n    \"s3_endpoint\": \"s3.us-east-1.amazonaws.com\",\r\n    \"s3_https\": 1,\r\n    \"s3_ssl\": 1\r\n  },\r\n  \"spark\": {\r\n    \"enable_spark_monitor\": true,\r\n    \"spark_master_url\": \"mesos://zk://zk-1.zk:2181,zk-2.zk:2181,zk-3.zk:2181,zk-4.zk:2181,zk-5.zk:2181/mesos\",\r\n    \"spark_driver_cores\": 2,\r\n    \"spark_driver_memory\": \"6g\",\r\n    \"spark_driver_java_options\": \"\\\"-server -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/mnt/mesos/sandbox\\\"\",\r\n    \"spark_history_fs_logdirectory\": \"hdfs://hdfs/history\",\r\n    \"spark_conf_spark_scheduler\": \"spark.scheduler.minRegisteredResourcesRatio=1.0\",\r\n    \"spark_conf_cores_max\": \"spark.cores.max=5\",\r\n    \"spark_conf_executor_cores\": \"spark.executor.cores=1\",\r\n    \"spark_conf_executor_memory\": \"spark.executor.memory=6g\",\r\n    \"spark_conf_executor_java_options\": \"spark.executor.extraJavaOptions=\\\"-server -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/mnt/mesos/sandbox\\\"\",\r\n    \"spark_conf_eventlog_enabled\": \"spark.eventLog.enabled=false\",\r\n    \"spark_conf_eventlog_dir\": \"spark.eventLog.dir=hdfs://hdfs/\",\r\n    \"spark_conf_hadoop_fs_s3a_aws_credentials_provider\": \"spark.hadoop.fs.s3a.aws.credentials.provider=com.amazonaws.auth.InstanceProfileCredentialsProvider\",\r\n    \"spark_conf_jars_packages\": \"spark.jars.packages=org.apache.spark:spark-streaming-kafka-0-10_2.11:2.2.1,org.apache.kafka:kafka_2.11:0.10.2.1\",\r\n    \"spark_conf_mesos_executor_docker_image\": \"spark.mesos.executor.docker.image=dcoslabs/dcos-spark:1.11.4-2.2.1\",\r\n    \"spark_conf_mesos_executor_home\": \"spark.mesos.executor.home=/opt/spark\",\r\n    \"spark_conf_mesos_containerizer\": \"spark.mesos.containerizer=mesos\",\r\n    \"spark_conf_mesos_driver_labels\": \"spark.mesos.driver.labels=DCOS_SPACE:\",\r\n    \"spark_conf_mesos_task_labels\": \"spark.mesos.task.labels=DCOS_SPACE:\",\r\n    \"spark_conf_executor_krb5_config\": \"spark.executorEnv.KRB5_CONFIG=/mnt/mesos/sandbox/krb5.conf\",\r\n    \"spark_conf_executor_java_home\": \"spark.executorEnv.JAVA_HOME=/opt/jdk\",\r\n    \"spark_conf_executor_hadoop_hdfs_home\": \"spark.executorEnv.HADOOP_HDFS_HOME=/opt/hadoop\",\r\n    \"spark_conf_executor_hadoop_opts\": \"spark.executorEnv.HADOOP_OPTS=\\\"-Djava.library.path=/opt/hadoop/lib/native -Djava.security.krb5.conf=/mnt/mesos/sandbox/krb5.conf\\\"\",\r\n    \"spark_conf_mesos_executor_docker_forcepullimage\": \"spark.mesos.executor.docker.forcePullImage=true\",\r\n    \"spark_user\": \"nobody\"\r\n  },\r\n  \"storage\": {\r\n    \"persistence\": {\r\n      \"host_volume_size\": 4000,\r\n      \"enable\": true\r\n    }\r\n  },\r\n  \"networking\": {\r\n    \"cni_support\": {\r\n      \"enabled\": true\r\n    },\r\n    \"external_access\": {\r\n      \"enabled\": true,\r\n      \"external_public_agent_hostname\": \"somethinghere.com\"\r\n    }\r\n  },\r\n  \"environment\": {\r\n    \"secrets\": false,\r\n    \"service_credential\": \"jupyterlab-notebook/serviceCredential\",\r\n    \"conda_envs_path\": \"/mnt/mesos/sandbox/conda/envs:/opt/conda/envs\",\r\n    \"conda_pkgs_dir\": \"/mnt/mesos/sandbox/conda/pkgs:/opt/conda/pkgs\",\r\n    \"dcos_dir\": \"/mnt/mesos/sandbox/.dcos\",\r\n    \"hadoop_conf_dir\": \"/mnt/mesos/sandbox\",\r\n    \"home\": \"/mnt/mesos/sandbox\",\r\n    \"java_opts\": \"\\\"-server -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/mnt/mesos/sandbox\\\"\",\r\n    \"jupyter_conf_urls\": \"\",\r\n    \"jupyter_config_dir\": \"/mnt/mesos/sandbox/.jupyter\",\r\n    \"jupyter_password\": \"\",\r\n    \"jupyter_runtime_dir\": \"/mnt/mesos/sandbox/.local/share/jupyter/runtime\",\r\n    \"nginx_log_level\": \"warn\",\r\n    \"start_dask_distributed\": false,\r\n    \"start_ray_head_node\": false,\r\n    \"start_spark_history_server\": false,\r\n    \"start_tensorboard\": false,\r\n    \"user\": \"nobody\",\r\n    \"tensorboard_logdir\": \"hdfs://hdfs/\",\r\n    \"term\": \"xterm-256color\"\r\n  }\r\n}\r\n```"},"comment":{"url":"https://api.github.com/repos/dcos-labs/dcos-jupyterlab-service/issues/comments/414304630","html_url":"https://github.com/dcos-labs/dcos-jupyterlab-service/issues/17#issuecomment-414304630","issue_url":"https://api.github.com/repos/dcos-labs/dcos-jupyterlab-service/issues/17","id":414304630,"node_id":"MDEyOklzc3VlQ29tbWVudDQxNDMwNDYzMA==","user":{"login":"vishnu2kmohan","id":3111797,"node_id":"MDQ6VXNlcjMxMTE3OTc=","avatar_url":"https://avatars3.githubusercontent.com/u/3111797?v=4","gravatar_id":"","url":"https://api.github.com/users/vishnu2kmohan","html_url":"https://github.com/vishnu2kmohan","followers_url":"https://api.github.com/users/vishnu2kmohan/followers","following_url":"https://api.github.com/users/vishnu2kmohan/following{/other_user}","gists_url":"https://api.github.com/users/vishnu2kmohan/gists{/gist_id}","starred_url":"https://api.github.com/users/vishnu2kmohan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vishnu2kmohan/subscriptions","organizations_url":"https://api.github.com/users/vishnu2kmohan/orgs","repos_url":"https://api.github.com/users/vishnu2kmohan/repos","events_url":"https://api.github.com/users/vishnu2kmohan/events{/privacy}","received_events_url":"https://api.github.com/users/vishnu2kmohan/received_events","type":"User","site_admin":false},"created_at":"2018-08-20T12:47:51Z","updated_at":"2018-08-20T12:47:51Z","author_association":"COLLABORATOR","body":"That said, support for [S3Contents](https://github.com/danielfrg/s3contents) (and [PGContents](https://github.com/quantopian/pgcontents)) will land once [pull/24](https://github.com/dcos-labs/dcos-jupyterlab-service/pull/24) is merged.\r\n\r\nWe also considered adding support for [HDFSContents](https://github.com/hopshadoop/hdfscontents) but [pydoop](https://github.com/crs4/pydoop) isn't ready for out-of-the-box [use with python3](https://github.com/crs4/pydoop/blob/develop/docs/installation.rst):\r\n```\r\nCollecting pydoop (from hdfscontents->-r /opt/conda/condaenv.b40ntw56.requirements.txt (line 5))\r\n  Downloading https://files.pythonhosted.org/packages/75/75/085a6410b085f231328884ca3349287a8705822ad8afdca715401e5c4f33/pydoop-1.2.0.tar.gz (956kB)\r\n    Complete output from command python setup.py egg_info:\r\n    Traceback (most recent call last):\r\n      File \"<string>\", line 1, in <module>\r\n      File \"/tmp/pip-install-e734_r5y/pydoop/setup.py\", line 45\r\n        print 'using setuptools version', setuptools.__version__\r\n                                       ^\r\n    SyntaxError: Missing parentheses in call to 'print'. Did you mean print('using setuptools version', setuptools.__version__)?\r\n    \r\n    ----------------------------------------\r\n```"}}
{"actor":{"display_login":"vishnu2kmohan"}}