{"action":"created","issue":{"url":"https://api.github.com/repos/saasbook/rag/issues/86","repository_url":"https://api.github.com/repos/saasbook/rag","labels_url":"https://api.github.com/repos/saasbook/rag/issues/86/labels{/name}","comments_url":"https://api.github.com/repos/saasbook/rag/issues/86/comments","events_url":"https://api.github.com/repos/saasbook/rag/issues/86/events","html_url":"https://github.com/saasbook/rag/issues/86","id":139764400,"number":86,"title":"HW4 Test Not Working? ","user":{"login":"zhangaaron","id":4034588,"avatar_url":"https://avatars.githubusercontent.com/u/4034588?v=3","gravatar_id":"","url":"https://api.github.com/users/zhangaaron","html_url":"https://github.com/zhangaaron","followers_url":"https://api.github.com/users/zhangaaron/followers","following_url":"https://api.github.com/users/zhangaaron/following{/other_user}","gists_url":"https://api.github.com/users/zhangaaron/gists{/gist_id}","starred_url":"https://api.github.com/users/zhangaaron/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zhangaaron/subscriptions","organizations_url":"https://api.github.com/users/zhangaaron/orgs","repos_url":"https://api.github.com/users/zhangaaron/repos","events_url":"https://api.github.com/users/zhangaaron/events{/privacy}","received_events_url":"https://api.github.com/users/zhangaaron/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"zhangaaron","id":4034588,"avatar_url":"https://avatars.githubusercontent.com/u/4034588?v=3","gravatar_id":"","url":"https://api.github.com/users/zhangaaron","html_url":"https://github.com/zhangaaron","followers_url":"https://api.github.com/users/zhangaaron/followers","following_url":"https://api.github.com/users/zhangaaron/following{/other_user}","gists_url":"https://api.github.com/users/zhangaaron/gists{/gist_id}","starred_url":"https://api.github.com/users/zhangaaron/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zhangaaron/subscriptions","organizations_url":"https://api.github.com/users/zhangaaron/orgs","repos_url":"https://api.github.com/users/zhangaaron/repos","events_url":"https://api.github.com/users/zhangaaron/events{/privacy}","received_events_url":"https://api.github.com/users/zhangaaron/received_events","type":"User","site_admin":false},"milestone":null,"comments":6,"created_at":"2016-03-10T02:28:10Z","updated_at":"2016-03-17T01:41:06Z","closed_at":null,"body":"Appears that the HW4 cucumber test is not working as intended. I'm unsure when this happened, or if this is an issue with the fact that we are running a Cucumber test suite within a Cucumber test suite and some environment variables are being reset during the test run. I seem to recall having some of these issues over the summer but I don't recall how I solved it, if I did. It hasn't been showing up on Travis because Travis doesn't run these tests, and the other tests don't have the problem since it doesn't get to running the Cucumber features. @tansaku, have you run into this issue during running the test suite? \r\n\r\n```\r\n bundle exec cucumber features/autograder_xqueue_stubbed.feature:47\r\nFeature: Autograder configured to accept student submissions from edX and grade them\r\n  As an instructor\r\n  So that I can give feedback to my students on their code responses\r\n  I want to be able to create a code submission page in edX and grade it using rag\r\n\r\n  @require_net_connect\r\n  Scenario: student submits a HW4                                      # features/autograder_xqueue_stubbed.feature:47\r\n    Given I set up a test that requires internet connection            # features/step_definitions/adapter_x_queue_steps.rb:24\r\n    Given an XQueue that has submission \"hw4_submission.json\" in queue # features/step_definitions/adapter_x_queue_steps.rb:28\r\n      [\"http://www.fakedownload.com/hw4.zip\"]\r\n      register_uri for : http://www.fakedownload.com/hw4.zip\r\n    And has been setup with the config file \"conf.yml\"                 # features/step_definitions/adapter_x_queue_steps.rb:44\r\n/media/aaron/why/sum2015/rag/lib/graders/feature_grader/lib/HW4feature.rb:151:in `rescue in run!': invalid cucumber results[\"Disabling profiles...\\n\", \"\\n\", \" *** ERROR: #<SystemExit: exit> *** \\n\", \"Run options: --seed 35036\\n\", \"\\n\", \"# Running:\\n\", \"\\n\", \"\\n\", \"\\n\", \"Finished in 0.001925s, 0.0000 runs/s, 0.0000 assertions/s.\\n\", \"\\n\", \"0 runs, 0 assertions, 0 failures, 0 errors, 0 skips\\n\"] (StandardError)\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/lib/HW4feature.rb:161:in `run!'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/lib/HW4feature.rb:45:in `block in total'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/lib/HW4feature.rb:42:in `each'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/lib/HW4feature.rb:42:in `total'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/hw4_grader.rb:242:in `check_ref_cucumber'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/hw4_grader.rb:109:in `block (2 levels) in runner_block'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/hw4_grader.rb:332:in `time_operation'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/hw4_grader.rb:105:in `block in runner_block'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/hw4_grader.rb:76:in `chdir'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/hw4_grader.rb:76:in `runner_block'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/auto_grader.rb:73:in `call'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/auto_grader.rb:73:in `block in run_in_subprocess'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/auto_grader.rb:69:in `fork'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/auto_grader.rb:69:in `run_in_subprocess'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/graders/feature_grader/hw4_grader.rb:55:in `grade'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/submission/base.rb:20:in `handle_submission'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/submission/polling.rb:19:in `block in run'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/submission/polling.rb:17:in `loop'\r\n\tfrom /media/aaron/why/sum2015/rag/lib/submission/polling.rb:17:in `run'\r\n\tfrom /media/aaron/why/sum2015/rag/features/step_definitions/adapter_x_queue_steps.rb:53:in `block (3 levels) in <top (required)>'\r\nSubmission message after grade: Your submission was recorded at 2010-06-19 18:52:28 -0700 : submission is on time.\r\nScore: 0/100\r\nThere was a fatal error with your submission. It either timed out or caused an exception.\r\n    Then I should receive a grade of \"100\" for my assignment           # features/step_definitions/adapter_x_queue_steps.rb:49\r\n      expected: == 100.0\r\n           got:    0.0 (RSpec::Expectations::ExpectationNotMetError)\r\n      ./features/step_definitions/adapter_x_queue_steps.rb:57:in `/^I should receive a grade of \"(.*?)\" for my assignment$/'\r\n      features/autograder_xqueue_stubbed.feature:51:in `Then I should receive a grade of \"100\" for my assignment'\r\n\r\nFailing Scenarios:\r\ncucumber features/autograder_xqueue_stubbed.feature:47 # Scenario: student submits a HW4\r\n\r\n1 scenario (1 failed)\r\n4 steps (1 failed, 3 passed)\r\n0m16.693s\r\n\r\n```"},"comment":{"url":"https://api.github.com/repos/saasbook/rag/issues/comments/197642731","html_url":"https://github.com/saasbook/rag/issues/86#issuecomment-197642731","issue_url":"https://api.github.com/repos/saasbook/rag/issues/86","id":197642731,"user":{"login":"zhangaaron","id":4034588,"avatar_url":"https://avatars.githubusercontent.com/u/4034588?v=3","gravatar_id":"","url":"https://api.github.com/users/zhangaaron","html_url":"https://github.com/zhangaaron","followers_url":"https://api.github.com/users/zhangaaron/followers","following_url":"https://api.github.com/users/zhangaaron/following{/other_user}","gists_url":"https://api.github.com/users/zhangaaron/gists{/gist_id}","starred_url":"https://api.github.com/users/zhangaaron/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zhangaaron/subscriptions","organizations_url":"https://api.github.com/users/zhangaaron/orgs","repos_url":"https://api.github.com/users/zhangaaron/repos","events_url":"https://api.github.com/users/zhangaaron/events{/privacy}","received_events_url":"https://api.github.com/users/zhangaaron/received_events","type":"User","site_admin":false},"created_at":"2016-03-17T01:41:06Z","updated_at":"2016-03-17T01:41:06Z","body":"still not sure exactly why error occured, but moving the project off my external hard drive onto primary drive fixed it. I agree with that sentiment but I think this is more of an issue with cucumber than anything else  "}}