{"action":"created","issue":{"url":"https://api.github.com/repos/iconara/rubydoop/issues/42","repository_url":"https://api.github.com/repos/iconara/rubydoop","labels_url":"https://api.github.com/repos/iconara/rubydoop/issues/42/labels{/name}","comments_url":"https://api.github.com/repos/iconara/rubydoop/issues/42/comments","events_url":"https://api.github.com/repos/iconara/rubydoop/issues/42/events","html_url":"https://github.com/iconara/rubydoop/issues/42","id":186666848,"number":42,"title":"Can't get things working on EMR 5.0.3","user":{"login":"bwebster","id":441162,"avatar_url":"https://avatars2.githubusercontent.com/u/441162?v=4","gravatar_id":"","url":"https://api.github.com/users/bwebster","html_url":"https://github.com/bwebster","followers_url":"https://api.github.com/users/bwebster/followers","following_url":"https://api.github.com/users/bwebster/following{/other_user}","gists_url":"https://api.github.com/users/bwebster/gists{/gist_id}","starred_url":"https://api.github.com/users/bwebster/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bwebster/subscriptions","organizations_url":"https://api.github.com/users/bwebster/orgs","repos_url":"https://api.github.com/users/bwebster/repos","events_url":"https://api.github.com/users/bwebster/events{/privacy}","received_events_url":"https://api.github.com/users/bwebster/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2016-11-01T22:36:40Z","updated_at":"2018-04-10T06:50:17Z","closed_at":null,"author_association":"NONE","body":"I'm prototyping out a solution to use Rubydoop on EMR.  I have written some jobs which I can run fine locally.  But when I try to execute it on EMR, I get the following error:\r\n```\r\nLoadError: no such file to load -- rubydoop\r\n  require at org/jruby/RubyKernel.java:956\r\n  require at uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:55\r\nException in thread \"main\" org.jruby.embed.InvokeFailedException: (LoadError) no such file to load -- rubydoop\r\n\tat org.jruby.embed.internal.EmbedRubyObjectAdapterImpl.call(EmbedRubyObjectAdapterImpl.java:320)\r\n\tat org.jruby.embed.internal.EmbedRubyObjectAdapterImpl.callMethod(EmbedRubyObjectAdapterImpl.java:250)\r\n\tat org.jruby.embed.ScriptingContainer.callMethod(ScriptingContainer.java:1412)\r\n\tat rubydoop.InstanceContainer.getRuntime(InstanceContainer.java:30)\r\n\tat rubydoop.RubydoopJobRunner.run(RubydoopJobRunner.java:25)\r\n\tat rubydoop.RubydoopJobRunner.run(RubydoopJobRunner.java:18)\r\n\tat org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)\r\n\tat org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)\r\n\tat rubydoop.RubydoopJobRunner.main(RubydoopJobRunner.java:50)\r\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\r\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\r\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\r\n\tat java.lang.reflect.Method.invoke(Method.java:498)\r\n\tat org.apache.hadoop.util.RunJar.run(RunJar.java:221)\r\n\tat org.apache.hadoop.util.RunJar.main(RunJar.java:136)\r\nCaused by: org.jruby.exceptions.RaiseException: (LoadError) no such file to load -- rubydoop\r\n\tat org.jruby.RubyKernel.require(org/jruby/RubyKernel.java:956)\r\n\tat RUBY.require(uri:classloader:/META-INF/jruby.home/lib/ruby/stdlib/rubygems/core_ext/kernel_require.rb:55)\r\n```\r\n\r\nIn terms of setup, I have run `rake package` and then uploaded the jar to an s3 bucket.  When configuring my cluster step, I am able to select the custom jar.  I then pass the following arguments: `test abc123`.  `test` is the name of the job script (`test.rb`) and `abc123` is the argument I want to pass.\r\n\r\nThe main class I'm trying to execute is `lib/test.rb` and looks like this:\r\n```\r\nrequire \"rubydoop\"\r\nrequire \"fileutils\"\r\n# ... other requires contained in lib/\r\n\r\nRubydoop.configure do |instance_id|\r\n  # do stuff\r\nend\r\n```\r\n\r\nAny ideas?"},"comment":{"url":"https://api.github.com/repos/iconara/rubydoop/issues/comments/379993063","html_url":"https://github.com/iconara/rubydoop/issues/42#issuecomment-379993063","issue_url":"https://api.github.com/repos/iconara/rubydoop/issues/42","id":379993063,"user":{"login":"iconara","id":73330,"avatar_url":"https://avatars3.githubusercontent.com/u/73330?v=4","gravatar_id":"","url":"https://api.github.com/users/iconara","html_url":"https://github.com/iconara","followers_url":"https://api.github.com/users/iconara/followers","following_url":"https://api.github.com/users/iconara/following{/other_user}","gists_url":"https://api.github.com/users/iconara/gists{/gist_id}","starred_url":"https://api.github.com/users/iconara/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/iconara/subscriptions","organizations_url":"https://api.github.com/users/iconara/orgs","repos_url":"https://api.github.com/users/iconara/repos","events_url":"https://api.github.com/users/iconara/events{/privacy}","received_events_url":"https://api.github.com/users/iconara/received_events","type":"User","site_admin":false},"created_at":"2018-04-10T06:50:17Z","updated_at":"2018-04-10T06:50:17Z","author_association":"OWNER","body":"@enifsieus sorry to hear that. I think that I would need some help to get Rubydoop up to date for newer Hadoop and JRuby versions. I have mostly moved away from Hadoop and only have some legacy jobs that still use Rubydoop."}}
{"actor":{"display_login":"iconara"}}