{"action":"created","issue":{"url":"https://api.github.com/repos/alt-code/AutoSpark/issues/55","repository_url":"https://api.github.com/repos/alt-code/AutoSpark","labels_url":"https://api.github.com/repos/alt-code/AutoSpark/issues/55/labels{/name}","comments_url":"https://api.github.com/repos/alt-code/AutoSpark/issues/55/comments","events_url":"https://api.github.com/repos/alt-code/AutoSpark/issues/55/events","html_url":"https://github.com/alt-code/AutoSpark/issues/55","id":133839559,"number":55,"title":"A failure while submitting the job","user":{"login":"amritbhanu","id":3458568,"avatar_url":"https://avatars.githubusercontent.com/u/3458568?v=3","gravatar_id":"","url":"https://api.github.com/users/amritbhanu","html_url":"https://github.com/amritbhanu","followers_url":"https://api.github.com/users/amritbhanu/followers","following_url":"https://api.github.com/users/amritbhanu/following{/other_user}","gists_url":"https://api.github.com/users/amritbhanu/gists{/gist_id}","starred_url":"https://api.github.com/users/amritbhanu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amritbhanu/subscriptions","organizations_url":"https://api.github.com/users/amritbhanu/orgs","repos_url":"https://api.github.com/users/amritbhanu/repos","events_url":"https://api.github.com/users/amritbhanu/events{/privacy}","received_events_url":"https://api.github.com/users/amritbhanu/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2016-02-15T23:09:27Z","updated_at":"2016-02-16T15:46:46Z","closed_at":null,"body":"I was able to successfully submit a job on master node which is being distributed to its 2 worker nodes.\r\nBut it failed to process it because of some extra thresholds set on the hardware of system which VCL instances aren't providing. I used the default config for setting the spark which needs to be changed. I am working on it.\r\n\r\nIn the meantime, figure shows the worker nodes and the following error.\r\n\r\n![file] (https://github.com/alt-code/AutoSpark/raw/master/Amrit/02-15/Screenshot%20from%202016-02-15%2017:57:36.png)"},"comment":{"url":"https://api.github.com/repos/alt-code/AutoSpark/issues/comments/184739457","html_url":"https://github.com/alt-code/AutoSpark/issues/55#issuecomment-184739457","issue_url":"https://api.github.com/repos/alt-code/AutoSpark/issues/55","id":184739457,"user":{"login":"amritbhanu","id":3458568,"avatar_url":"https://avatars.githubusercontent.com/u/3458568?v=3","gravatar_id":"","url":"https://api.github.com/users/amritbhanu","html_url":"https://github.com/amritbhanu","followers_url":"https://api.github.com/users/amritbhanu/followers","following_url":"https://api.github.com/users/amritbhanu/following{/other_user}","gists_url":"https://api.github.com/users/amritbhanu/gists{/gist_id}","starred_url":"https://api.github.com/users/amritbhanu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amritbhanu/subscriptions","organizations_url":"https://api.github.com/users/amritbhanu/orgs","repos_url":"https://api.github.com/users/amritbhanu/repos","events_url":"https://api.github.com/users/amritbhanu/events{/privacy}","received_events_url":"https://api.github.com/users/amritbhanu/received_events","type":"User","site_admin":false},"created_at":"2016-02-16T15:46:46Z","updated_at":"2016-02-16T15:46:46Z","body":"## Experiment on CS.txt (7 MB) file\r\n### Results are successful.\r\n - The total time taken by each node and the tast distributed across slave nodes can be seen.\r\n\r\n![file] (https://github.com/alt-code/AutoSpark/raw/master/Amrit/02-15/cs_lda_4.png) \r\n\r\n## Experiment on jones.txt (84 MB) file\r\n\r\n - It didnt succeed by ending abruptly throwing Out of memory error. It happened initially with our experiments before we switched to AWS.\r\n - I am not able to reserve more than 4 nodes so I haven't tested with better config for such a large file."}}