{"action":"created","issue":{"url":"https://api.github.com/repos/huawei-noah/streamDM/issues/97","repository_url":"https://api.github.com/repos/huawei-noah/streamDM","labels_url":"https://api.github.com/repos/huawei-noah/streamDM/issues/97/labels{/name}","comments_url":"https://api.github.com/repos/huawei-noah/streamDM/issues/97/comments","events_url":"https://api.github.com/repos/huawei-noah/streamDM/issues/97/events","html_url":"https://github.com/huawei-noah/streamDM/issues/97","id":331341100,"node_id":"MDU6SXNzdWUzMzEzNDExMDA=","number":97,"title":"Bug Report StreamKM Clusterer","user":{"login":"ioanna-ki","id":17323731,"node_id":"MDQ6VXNlcjE3MzIzNzMx","avatar_url":"https://avatars2.githubusercontent.com/u/17323731?v=4","gravatar_id":"","url":"https://api.github.com/users/ioanna-ki","html_url":"https://github.com/ioanna-ki","followers_url":"https://api.github.com/users/ioanna-ki/followers","following_url":"https://api.github.com/users/ioanna-ki/following{/other_user}","gists_url":"https://api.github.com/users/ioanna-ki/gists{/gist_id}","starred_url":"https://api.github.com/users/ioanna-ki/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ioanna-ki/subscriptions","organizations_url":"https://api.github.com/users/ioanna-ki/orgs","repos_url":"https://api.github.com/users/ioanna-ki/repos","events_url":"https://api.github.com/users/ioanna-ki/events{/privacy}","received_events_url":"https://api.github.com/users/ioanna-ki/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"hmgomes","id":7343198,"node_id":"MDQ6VXNlcjczNDMxOTg=","avatar_url":"https://avatars1.githubusercontent.com/u/7343198?v=4","gravatar_id":"","url":"https://api.github.com/users/hmgomes","html_url":"https://github.com/hmgomes","followers_url":"https://api.github.com/users/hmgomes/followers","following_url":"https://api.github.com/users/hmgomes/following{/other_user}","gists_url":"https://api.github.com/users/hmgomes/gists{/gist_id}","starred_url":"https://api.github.com/users/hmgomes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hmgomes/subscriptions","organizations_url":"https://api.github.com/users/hmgomes/orgs","repos_url":"https://api.github.com/users/hmgomes/repos","events_url":"https://api.github.com/users/hmgomes/events{/privacy}","received_events_url":"https://api.github.com/users/hmgomes/received_events","type":"User","site_admin":false},"assignees":[{"login":"hmgomes","id":7343198,"node_id":"MDQ6VXNlcjczNDMxOTg=","avatar_url":"https://avatars1.githubusercontent.com/u/7343198?v=4","gravatar_id":"","url":"https://api.github.com/users/hmgomes","html_url":"https://github.com/hmgomes","followers_url":"https://api.github.com/users/hmgomes/followers","following_url":"https://api.github.com/users/hmgomes/following{/other_user}","gists_url":"https://api.github.com/users/hmgomes/gists{/gist_id}","starred_url":"https://api.github.com/users/hmgomes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hmgomes/subscriptions","organizations_url":"https://api.github.com/users/hmgomes/orgs","repos_url":"https://api.github.com/users/hmgomes/repos","events_url":"https://api.github.com/users/hmgomes/events{/privacy}","received_events_url":"https://api.github.com/users/hmgomes/received_events","type":"User","site_admin":false}],"milestone":null,"comments":0,"created_at":"2018-06-11T20:38:43Z","updated_at":"2018-06-21T14:39:44Z","closed_at":null,"author_association":"NONE","body":"# Bug Report StreamKM Clusterer\r\n\r\n## Expected behavior\r\n_StreamKM should be keeping an up to date coreset tree, while doing kmeans clustering and assigning each input element to its nearest center._\r\n\r\n## Observed behavior\r\n_All the input assigned in one cluster. The counter of instances, the updated bucketmanager and the variable clusters are keeping their values only inside the foreachRDD action. So, when we are calling the assign function, there aren't any data to proceed._\r\n\r\n## Steps to reproduce the issue\r\nused the iris.arff\r\n**Command line**\r\n_./spark.sh \"ClusteringTrainEvaluate -c (StreamKM) -s (SocketTextStreamReader)\" 1> result_iris_streamKM.txt 2> log_iris_streamKM.log_\r\n\r\nThere isn't an error message but if you print the output of the assign function (clpairs) each element is assigned to cluster's index 0\r\n\r\n**Infrastructure details**\r\n* **Java Version:** 1.8.0_144 \r\n* **Scala Version:**  2.11.6\r\n* **Spark version:**  2.2.0\r\n* **OS version:**  ubuntu 16.4\r\n* **Spark Standalone cluster mode** \r\n"},"comment":{"url":"https://api.github.com/repos/huawei-noah/streamDM/issues/comments/399127404","html_url":"https://github.com/huawei-noah/streamDM/issues/97#issuecomment-399127404","issue_url":"https://api.github.com/repos/huawei-noah/streamDM/issues/97","id":399127404,"node_id":"MDEyOklzc3VlQ29tbWVudDM5OTEyNzQwNA==","user":{"login":"hmgomes","id":7343198,"node_id":"MDQ6VXNlcjczNDMxOTg=","avatar_url":"https://avatars1.githubusercontent.com/u/7343198?v=4","gravatar_id":"","url":"https://api.github.com/users/hmgomes","html_url":"https://github.com/hmgomes","followers_url":"https://api.github.com/users/hmgomes/followers","following_url":"https://api.github.com/users/hmgomes/following{/other_user}","gists_url":"https://api.github.com/users/hmgomes/gists{/gist_id}","starred_url":"https://api.github.com/users/hmgomes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hmgomes/subscriptions","organizations_url":"https://api.github.com/users/hmgomes/orgs","repos_url":"https://api.github.com/users/hmgomes/repos","events_url":"https://api.github.com/users/hmgomes/events{/privacy}","received_events_url":"https://api.github.com/users/hmgomes/received_events","type":"User","site_admin":false},"created_at":"2018-06-21T14:39:44Z","updated_at":"2018-06-21T14:39:44Z","author_association":"CONTRIBUTOR","body":"Hi @ioanna-ki \r\nI believe it is easier for others to test it using the FileReader option, something like:\r\n\r\n*./spark.sh \"ClusteringTrainEvaluate -c (StreamKM) -s (FileReader -f ../data/iris.arff -k 10 -d 10 -i 150)\" 1> result_iris_streamKM.txt 2> log_iris_streamKM.log*\r\n\r\nBest Regards, \r\nHeitor"}}
{"actor":{"display_login":"hmgomes"}}