{"action":"created","comment":{"url":"https://api.github.com/repos/apache/spark/pulls/comments/53391878","id":53391878,"diff_hunk":"@@ -0,0 +1,69 @@\n+/*\n+ * Licensed to the Apache Software Foundation (ASF) under one or more\n+ * contributor license agreements.  See the NOTICE file distributed with\n+ * this work for additional information regarding copyright ownership.\n+ * The ASF licenses this file to You under the Apache License, Version 2.0\n+ * (the \"License\"); you may not use this file except in compliance with\n+ * the License.  You may obtain a copy of the License at\n+ *\n+ *    http://www.apache.org/licenses/LICENSE-2.0\n+ *\n+ * Unless required by applicable law or agreed to in writing, software\n+ * distributed under the License is distributed on an \"AS IS\" BASIS,\n+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n+ * See the License for the specific language governing permissions and\n+ * limitations under the License.\n+ */\n+\n+package org.apache.spark.examples.mllib;\n+\n+// $example on$\n+import org.apache.spark.api.java.*;\n+import org.apache.spark.api.java.function.Function;\n+import org.apache.spark.mllib.clustering.GaussianMixture;\n+import org.apache.spark.mllib.clustering.GaussianMixtureModel;\n+import org.apache.spark.mllib.linalg.Vector;\n+import org.apache.spark.mllib.linalg.Vectors;\n+// $example off$\n+\n+import org.apache.spark.SparkConf;\n+\n+public class JavaGaussianMixtureExample {\n+  public static void main(String[] args) {\n+\n+    SparkConf conf = new SparkConf().setAppName(\"JavaGaussianMixtureExample\");\n+    JavaSparkContext jsc = new JavaSparkContext(conf);\n+\n+    // $example on$\n+    // Load and parse data\n+    String path = \"data/mllib/gmm_data.txt\";\n+    JavaRDD<String> data = jsc.textFile(path);\n+    JavaRDD<Vector> parsedData = data.map(\n+        new Function<String, Vector>() {\n+            public Vector call(String s) {\n+                String[] sarray = s.trim().split(\" \");","path":"examples/src/main/java/org/apache/spark/examples/mllib/JavaGaussianMixtureExample.java","position":44,"original_position":44,"commit_id":"ba502d691de9a5717d2ecbb0601a2f78e4264900","original_commit_id":"ba502d691de9a5717d2ecbb0601a2f78e4264900","user":{"login":"yinxusen","id":2637239,"avatar_url":"https://avatars.githubusercontent.com/u/2637239?v=3","gravatar_id":"","url":"https://api.github.com/users/yinxusen","html_url":"https://github.com/yinxusen","followers_url":"https://api.github.com/users/yinxusen/followers","following_url":"https://api.github.com/users/yinxusen/following{/other_user}","gists_url":"https://api.github.com/users/yinxusen/gists{/gist_id}","starred_url":"https://api.github.com/users/yinxusen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yinxusen/subscriptions","organizations_url":"https://api.github.com/users/yinxusen/orgs","repos_url":"https://api.github.com/users/yinxusen/repos","events_url":"https://api.github.com/users/yinxusen/events{/privacy}","received_events_url":"https://api.github.com/users/yinxusen/received_events","type":"User","site_admin":false},"body":"ditto","created_at":"2016-02-18T22:17:11Z","updated_at":"2016-02-18T22:17:11Z","html_url":"https://github.com/apache/spark/pull/11116#discussion_r53391878","pull_request_url":"https://api.github.com/repos/apache/spark/pulls/11116","_links":{"self":{"href":"https://api.github.com/repos/apache/spark/pulls/comments/53391878"},"html":{"href":"https://github.com/apache/spark/pull/11116#discussion_r53391878"},"pull_request":{"href":"https://api.github.com/repos/apache/spark/pulls/11116"}}},"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/11116","id":58616743,"html_url":"https://github.com/apache/spark/pull/11116","diff_url":"https://github.com/apache/spark/pull/11116.diff","patch_url":"https://github.com/apache/spark/pull/11116.patch","issue_url":"https://api.github.com/repos/apache/spark/issues/11116","number":11116,"state":"open","locked":false,"title":"[SPARK-13013][Docs] Replace example code in mllib-clustering.md using include_example","user":{"login":"keypointt","id":3925641,"avatar_url":"https://avatars.githubusercontent.com/u/3925641?v=3","gravatar_id":"","url":"https://api.github.com/users/keypointt","html_url":"https://github.com/keypointt","followers_url":"https://api.github.com/users/keypointt/followers","following_url":"https://api.github.com/users/keypointt/following{/other_user}","gists_url":"https://api.github.com/users/keypointt/gists{/gist_id}","starred_url":"https://api.github.com/users/keypointt/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/keypointt/subscriptions","organizations_url":"https://api.github.com/users/keypointt/orgs","repos_url":"https://api.github.com/users/keypointt/repos","events_url":"https://api.github.com/users/keypointt/events{/privacy}","received_events_url":"https://api.github.com/users/keypointt/received_events","type":"User","site_admin":false},"body":"Replace example code in mllib-clustering.md using include_example\r\nhttps://issues.apache.org/jira/browse/SPARK-13013\r\n\r\nThe example code in the user guide is embedded in the markdown and hence it is not easy to test. It would be nice to automatically test them. This JIRA is to discuss options to automate example code testing and see what we can do in Spark 1.6.\r\n\r\nGoal is to move actual example code to spark/examples and test compilation in Jenkins builds. Then in the markdown, we can reference part of the code to show in the user guide. This requires adding a Jekyll tag that is similar to https://github.com/jekyll/jekyll/blob/master/lib/jekyll/tags/include.rb, e.g., called include_example.\r\n`{% include_example scala/org/apache/spark/examples/mllib/KMeansExample.scala %}`\r\nJekyll will find `examples/src/main/scala/org/apache/spark/examples/mllib/KMeansExample.scala` and pick code blocks marked \"example\" and replace code block in \r\n`{% highlight %}`\r\n in the markdown. \r\n\r\nSee more sub-tasks in parent ticket: https://issues.apache.org/jira/browse/SPARK-11337","created_at":"2016-02-08T14:36:52Z","updated_at":"2016-02-18T22:17:11Z","closed_at":null,"merged_at":null,"merge_commit_sha":"83491617eca3210de899215161c2424b23e76128","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/apache/spark/pulls/11116/commits","review_comments_url":"https://api.github.com/repos/apache/spark/pulls/11116/comments","review_comment_url":"https://api.github.com/repos/apache/spark/pulls/comments{/number}","comments_url":"https://api.github.com/repos/apache/spark/issues/11116/comments","statuses_url":"https://api.github.com/repos/apache/spark/statuses/ba502d691de9a5717d2ecbb0601a2f78e4264900","head":{"label":"keypointt:SPARK-13013","ref":"SPARK-13013","sha":"ba502d691de9a5717d2ecbb0601a2f78e4264900","user":{"login":"keypointt","id":3925641,"avatar_url":"https://avatars.githubusercontent.com/u/3925641?v=3","gravatar_id":"","url":"https://api.github.com/users/keypointt","html_url":"https://github.com/keypointt","followers_url":"https://api.github.com/users/keypointt/followers","following_url":"https://api.github.com/users/keypointt/following{/other_user}","gists_url":"https://api.github.com/users/keypointt/gists{/gist_id}","starred_url":"https://api.github.com/users/keypointt/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/keypointt/subscriptions","organizations_url":"https://api.github.com/users/keypointt/orgs","repos_url":"https://api.github.com/users/keypointt/repos","events_url":"https://api.github.com/users/keypointt/events{/privacy}","received_events_url":"https://api.github.com/users/keypointt/received_events","type":"User","site_admin":false},"repo":{"id":43392545,"name":"spark","full_name":"keypointt/spark","owner":{"login":"keypointt","id":3925641,"avatar_url":"https://avatars.githubusercontent.com/u/3925641?v=3","gravatar_id":"","url":"https://api.github.com/users/keypointt","html_url":"https://github.com/keypointt","followers_url":"https://api.github.com/users/keypointt/followers","following_url":"https://api.github.com/users/keypointt/following{/other_user}","gists_url":"https://api.github.com/users/keypointt/gists{/gist_id}","starred_url":"https://api.github.com/users/keypointt/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/keypointt/subscriptions","organizations_url":"https://api.github.com/users/keypointt/orgs","repos_url":"https://api.github.com/users/keypointt/repos","events_url":"https://api.github.com/users/keypointt/events{/privacy}","received_events_url":"https://api.github.com/users/keypointt/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/keypointt/spark","description":"Mirror of Apache Spark","fork":true,"url":"https://api.github.com/repos/keypointt/spark","forks_url":"https://api.github.com/repos/keypointt/spark/forks","keys_url":"https://api.github.com/repos/keypointt/spark/keys{/key_id}","collaborators_url":"https://api.github.com/repos/keypointt/spark/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/keypointt/spark/teams","hooks_url":"https://api.github.com/repos/keypointt/spark/hooks","issue_events_url":"https://api.github.com/repos/keypointt/spark/issues/events{/number}","events_url":"https://api.github.com/repos/keypointt/spark/events","assignees_url":"https://api.github.com/repos/keypointt/spark/assignees{/user}","branches_url":"https://api.github.com/repos/keypointt/spark/branches{/branch}","tags_url":"https://api.github.com/repos/keypointt/spark/tags","blobs_url":"https://api.github.com/repos/keypointt/spark/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/keypointt/spark/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/keypointt/spark/git/refs{/sha}","trees_url":"https://api.github.com/repos/keypointt/spark/git/trees{/sha}","statuses_url":"https://api.github.com/repos/keypointt/spark/statuses/{sha}","languages_url":"https://api.github.com/repos/keypointt/spark/languages","stargazers_url":"https://api.github.com/repos/keypointt/spark/stargazers","contributors_url":"https://api.github.com/repos/keypointt/spark/contributors","subscribers_url":"https://api.github.com/repos/keypointt/spark/subscribers","subscription_url":"https://api.github.com/repos/keypointt/spark/subscription","commits_url":"https://api.github.com/repos/keypointt/spark/commits{/sha}","git_commits_url":"https://api.github.com/repos/keypointt/spark/git/commits{/sha}","comments_url":"https://api.github.com/repos/keypointt/spark/comments{/number}","issue_comment_url":"https://api.github.com/repos/keypointt/spark/issues/comments{/number}","contents_url":"https://api.github.com/repos/keypointt/spark/contents/{+path}","compare_url":"https://api.github.com/repos/keypointt/spark/compare/{base}...{head}","merges_url":"https://api.github.com/repos/keypointt/spark/merges","archive_url":"https://api.github.com/repos/keypointt/spark/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/keypointt/spark/downloads","issues_url":"https://api.github.com/repos/keypointt/spark/issues{/number}","pulls_url":"https://api.github.com/repos/keypointt/spark/pulls{/number}","milestones_url":"https://api.github.com/repos/keypointt/spark/milestones{/number}","notifications_url":"https://api.github.com/repos/keypointt/spark/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/keypointt/spark/labels{/name}","releases_url":"https://api.github.com/repos/keypointt/spark/releases{/id}","deployments_url":"https://api.github.com/repos/keypointt/spark/deployments","created_at":"2015-09-29T20:27:14Z","updated_at":"2016-02-01T05:16:23Z","pushed_at":"2016-02-18T08:55:19Z","git_url":"git://github.com/keypointt/spark.git","ssh_url":"git@github.com:keypointt/spark.git","clone_url":"https://github.com/keypointt/spark.git","svn_url":"https://github.com/keypointt/spark","homepage":null,"size":145235,"stargazers_count":0,"watchers_count":0,"language":"Scala","has_issues":false,"has_downloads":true,"has_wiki":false,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"apache:master","ref":"master","sha":"140ddef373680cb08a3948a883b172dc80814170","user":{"login":"apache","id":47359,"avatar_url":"https://avatars.githubusercontent.com/u/47359?v=3","gravatar_id":"","url":"https://api.github.com/users/apache","html_url":"https://github.com/apache","followers_url":"https://api.github.com/users/apache/followers","following_url":"https://api.github.com/users/apache/following{/other_user}","gists_url":"https://api.github.com/users/apache/gists{/gist_id}","starred_url":"https://api.github.com/users/apache/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/apache/subscriptions","organizations_url":"https://api.github.com/users/apache/orgs","repos_url":"https://api.github.com/users/apache/repos","events_url":"https://api.github.com/users/apache/events{/privacy}","received_events_url":"https://api.github.com/users/apache/received_events","type":"Organization","site_admin":false},"repo":{"id":17165658,"name":"spark","full_name":"apache/spark","owner":{"login":"apache","id":47359,"avatar_url":"https://avatars.githubusercontent.com/u/47359?v=3","gravatar_id":"","url":"https://api.github.com/users/apache","html_url":"https://github.com/apache","followers_url":"https://api.github.com/users/apache/followers","following_url":"https://api.github.com/users/apache/following{/other_user}","gists_url":"https://api.github.com/users/apache/gists{/gist_id}","starred_url":"https://api.github.com/users/apache/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/apache/subscriptions","organizations_url":"https://api.github.com/users/apache/orgs","repos_url":"https://api.github.com/users/apache/repos","events_url":"https://api.github.com/users/apache/events{/privacy}","received_events_url":"https://api.github.com/users/apache/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/apache/spark","description":"Mirror of Apache Spark","fork":false,"url":"https://api.github.com/repos/apache/spark","forks_url":"https://api.github.com/repos/apache/spark/forks","keys_url":"https://api.github.com/repos/apache/spark/keys{/key_id}","collaborators_url":"https://api.github.com/repos/apache/spark/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/apache/spark/teams","hooks_url":"https://api.github.com/repos/apache/spark/hooks","issue_events_url":"https://api.github.com/repos/apache/spark/issues/events{/number}","events_url":"https://api.github.com/repos/apache/spark/events","assignees_url":"https://api.github.com/repos/apache/spark/assignees{/user}","branches_url":"https://api.github.com/repos/apache/spark/branches{/branch}","tags_url":"https://api.github.com/repos/apache/spark/tags","blobs_url":"https://api.github.com/repos/apache/spark/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/apache/spark/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/apache/spark/git/refs{/sha}","trees_url":"https://api.github.com/repos/apache/spark/git/trees{/sha}","statuses_url":"https://api.github.com/repos/apache/spark/statuses/{sha}","languages_url":"https://api.github.com/repos/apache/spark/languages","stargazers_url":"https://api.github.com/repos/apache/spark/stargazers","contributors_url":"https://api.github.com/repos/apache/spark/contributors","subscribers_url":"https://api.github.com/repos/apache/spark/subscribers","subscription_url":"https://api.github.com/repos/apache/spark/subscription","commits_url":"https://api.github.com/repos/apache/spark/commits{/sha}","git_commits_url":"https://api.github.com/repos/apache/spark/git/commits{/sha}","comments_url":"https://api.github.com/repos/apache/spark/comments{/number}","issue_comment_url":"https://api.github.com/repos/apache/spark/issues/comments{/number}","contents_url":"https://api.github.com/repos/apache/spark/contents/{+path}","compare_url":"https://api.github.com/repos/apache/spark/compare/{base}...{head}","merges_url":"https://api.github.com/repos/apache/spark/merges","archive_url":"https://api.github.com/repos/apache/spark/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/apache/spark/downloads","issues_url":"https://api.github.com/repos/apache/spark/issues{/number}","pulls_url":"https://api.github.com/repos/apache/spark/pulls{/number}","milestones_url":"https://api.github.com/repos/apache/spark/milestones{/number}","notifications_url":"https://api.github.com/repos/apache/spark/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/apache/spark/labels{/name}","releases_url":"https://api.github.com/repos/apache/spark/releases{/id}","deployments_url":"https://api.github.com/repos/apache/spark/deployments","created_at":"2014-02-25T08:00:08Z","updated_at":"2016-02-18T18:51:57Z","pushed_at":"2016-02-18T22:16:32Z","git_url":"git://github.com/apache/spark.git","ssh_url":"git@github.com:apache/spark.git","clone_url":"https://github.com/apache/spark.git","svn_url":"https://github.com/apache/spark","homepage":null,"size":414642,"stargazers_count":7480,"watchers_count":7480,"language":"Scala","has_issues":false,"has_downloads":true,"has_wiki":false,"has_pages":false,"forks_count":6808,"mirror_url":"git://git.apache.org/spark.git","open_issues_count":385,"forks":6808,"open_issues":385,"watchers":7480,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/apache/spark/pulls/11116"},"html":{"href":"https://github.com/apache/spark/pull/11116"},"issue":{"href":"https://api.github.com/repos/apache/spark/issues/11116"},"comments":{"href":"https://api.github.com/repos/apache/spark/issues/11116/comments"},"review_comments":{"href":"https://api.github.com/repos/apache/spark/pulls/11116/comments"},"review_comment":{"href":"https://api.github.com/repos/apache/spark/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/apache/spark/pulls/11116/commits"},"statuses":{"href":"https://api.github.com/repos/apache/spark/statuses/ba502d691de9a5717d2ecbb0601a2f78e4264900"}}}}