{"action":"created","issue":{"url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/288","repository_url":"https://api.github.com/repos/intel-hadoop/HiBench","labels_url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/288/labels{/name}","comments_url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/288/comments","events_url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/288/events","html_url":"https://github.com/intel-hadoop/HiBench/pull/288","id":173206777,"number":288,"title":"Modify docker module errors and deploy docker image on openjdk","user":{"login":"zybing","id":8530791,"avatar_url":"https://avatars.githubusercontent.com/u/8530791?v=3","gravatar_id":"","url":"https://api.github.com/users/zybing","html_url":"https://github.com/zybing","followers_url":"https://api.github.com/users/zybing/followers","following_url":"https://api.github.com/users/zybing/following{/other_user}","gists_url":"https://api.github.com/users/zybing/gists{/gist_id}","starred_url":"https://api.github.com/users/zybing/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zybing/subscriptions","organizations_url":"https://api.github.com/users/zybing/orgs","repos_url":"https://api.github.com/users/zybing/repos","events_url":"https://api.github.com/users/zybing/events{/privacy}","received_events_url":"https://api.github.com/users/zybing/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2016-08-25T13:43:50Z","updated_at":"2016-08-26T07:35:11Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/intel-hadoop/HiBench/pulls/288","html_url":"https://github.com/intel-hadoop/HiBench/pull/288","diff_url":"https://github.com/intel-hadoop/HiBench/pull/288.diff","patch_url":"https://github.com/intel-hadoop/HiBench/pull/288.patch"},"body":"# Modify docker module errors\r\n### 1.move `#!bin/bash` to the first line for all shell script files.\r\n### 2.add comment for the license information of xml files.\r\n     e.g.<!--# Licensed to the Apache Software Foundation (ASF) under one or more....-->\r\nwithout the `<!--..-->`comment, the xml file will not be parsed correctly.\r\n### 3.modify the scripts/gen_base_dockerfile.sh error\r\nin line 58 ,the `sed` statment doesn't work because of syntax error\r\n### 4.when maven compiles storm benchmark ,the error of lacking of thrift be throwed.\r\nTo resolve the problem, add `RUN apt-get update && apt-get install -y thrift-compiler` to the base/base-core file\r\n### 5.modify cdh-docker/Dockerfile file\r\nthe last line in cdh-docker/Dockerfile is `CMD bash -C '/usr/bin/restart-hadoop-spark.sh'; 'bash'` . But it is not a good solution to run docker container in Dockerfile.  I delete this line and write a new runexample.sh to replace it.\r\n### 6.add cdh-docker/scripts/runexample.sh file\r\nusing this file to run docker container,the content as follow:\r\n`#modify etc/hosts file to avoid connection error`\r\n`cp /etc/hosts /etc/hostsbak`\r\n`sed -i 's/::1/#::1/' /etc/hostsbak`\r\n`cat /etc/hostsbak > /etc/hosts`\r\n`rm -rf /etc/hostsbak`\r\n`#run wordcount example`\r\n`/usr/bin/restart-hadoop-spark.sh`\r\n`${HIBENCH_HOME}/workloads/wordcount/prepare/prepare.sh`\r\n`${HIBENCH_HOME}/workloads/wordcount/mapreduce/bin/run.sh`\r\n### 7.modify script/run_container.sh file\r\nmodify the last line. modify the run docker container method\r\n### 8.modify opensource-docker module\r\nit is similar with cdh-docker module\r\n### 9.change the default maven version to 3.0.5 in hibench-docker.conf file\r\n\r\n\r\n# Deploy docker image on openjdk\r\n### 1.modify base/base-core file. change the oracle-jdk installation to openjdk installation. code as follow:\r\n`# Install Java`\r\n`RUN \\`\r\n  `apt-get update && \\`\r\n ` apt-get install -y openjdk-${JDK_VERSION}-jdk`\r\n`# Define commonly used JAVA_HOME variable`\r\n`ENV JAVA_HOME /usr/lib/jvm/java-${JDK_VERSION}-openjdk-amd64`\r\n`ENV PATH $PATH:$JAVA_HOME/bin`\r\n### 2.modify cdh-docker(opensource-docker)/scripts/hadoop-env.sh file. code as follow:\r\n`export JAVA_HOME=\"/usr/lib/jvm/java-7-openjdk-amd64\"`"},"comment":{"url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/comments/242652614","html_url":"https://github.com/intel-hadoop/HiBench/pull/288#issuecomment-242652614","issue_url":"https://api.github.com/repos/intel-hadoop/HiBench/issues/288","id":242652614,"user":{"login":"zybing","id":8530791,"avatar_url":"https://avatars.githubusercontent.com/u/8530791?v=3","gravatar_id":"","url":"https://api.github.com/users/zybing","html_url":"https://github.com/zybing","followers_url":"https://api.github.com/users/zybing/followers","following_url":"https://api.github.com/users/zybing/following{/other_user}","gists_url":"https://api.github.com/users/zybing/gists{/gist_id}","starred_url":"https://api.github.com/users/zybing/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zybing/subscriptions","organizations_url":"https://api.github.com/users/zybing/orgs","repos_url":"https://api.github.com/users/zybing/repos","events_url":"https://api.github.com/users/zybing/events{/privacy}","received_events_url":"https://api.github.com/users/zybing/received_events","type":"User","site_admin":false},"created_at":"2016-08-26T07:35:11Z","updated_at":"2016-08-26T07:35:11Z","body":"# modify some error in opensource-docker module\r\n### 1.modify opensource-docker/Dockerfile error\r\nin line 67, 68. copy directory(**/root**) is error , change it as follow:\r\n'COPY scripts/restart-hadoop-spark.sh **/usr/bin**'\r\n'RUN chmod +x **/usr/bin**/restart-hadoop-spark.sh'\r\n### 2.change spark vesion in hibench-docker.conf\r\nIn this mirror(http://mirror.reverse.net/pub/apache/spark/) , the minimum spark version is 1.5.2.\r\n1.3 is not supported. \r\n### 3.In base/base-core file, adopt build-all.sh to compile hibench project\r\n/bin/build-all.sh can be used to built hibench for all known Spark and MR versions \r\n### 4.set opensource docker and cdh docker different name\r\nby this way , opensource-docker module and cdh-docker module can be built to different docker image.\r\n\r\n"}}
{"actor":{"display_login":"zybing"}}