{"action":"created","issue":{"url":"https://api.github.com/repos/oppia/oppia/issues/995","repository_url":"https://api.github.com/repos/oppia/oppia","labels_url":"https://api.github.com/repos/oppia/oppia/issues/995/labels{/name}","comments_url":"https://api.github.com/repos/oppia/oppia/issues/995/comments","events_url":"https://api.github.com/repos/oppia/oppia/issues/995/events","html_url":"https://github.com/oppia/oppia/issues/995","id":108803297,"number":995,"title":"Add Protractor e2e tests to Travis-CI","user":{"login":"seanlip","id":10575562,"avatar_url":"https://avatars.githubusercontent.com/u/10575562?v=3","gravatar_id":"","url":"https://api.github.com/users/seanlip","html_url":"https://github.com/seanlip","followers_url":"https://api.github.com/users/seanlip/followers","following_url":"https://api.github.com/users/seanlip/following{/other_user}","gists_url":"https://api.github.com/users/seanlip/gists{/gist_id}","starred_url":"https://api.github.com/users/seanlip/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/seanlip/subscriptions","organizations_url":"https://api.github.com/users/seanlip/orgs","repos_url":"https://api.github.com/users/seanlip/repos","events_url":"https://api.github.com/users/seanlip/events{/privacy}","received_events_url":"https://api.github.com/users/seanlip/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/oppia/oppia/labels/backend/development-workflow","name":"backend/development-workflow","color":"eeeeee"},{"url":"https://api.github.com/repos/oppia/oppia/labels/feature:%20important","name":"feature: important","color":"fbca04"},{"url":"https://api.github.com/repos/oppia/oppia/labels/TODO:%20tech%20(instructions)","name":"TODO: tech (instructions)","color":"bfd4f2"}],"state":"open","locked":false,"assignee":{"login":"bbriggs","id":2350379,"avatar_url":"https://avatars.githubusercontent.com/u/2350379?v=3","gravatar_id":"","url":"https://api.github.com/users/bbriggs","html_url":"https://github.com/bbriggs","followers_url":"https://api.github.com/users/bbriggs/followers","following_url":"https://api.github.com/users/bbriggs/following{/other_user}","gists_url":"https://api.github.com/users/bbriggs/gists{/gist_id}","starred_url":"https://api.github.com/users/bbriggs/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bbriggs/subscriptions","organizations_url":"https://api.github.com/users/bbriggs/orgs","repos_url":"https://api.github.com/users/bbriggs/repos","events_url":"https://api.github.com/users/bbriggs/events{/privacy}","received_events_url":"https://api.github.com/users/bbriggs/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/oppia/oppia/milestones/24","html_url":"https://github.com/oppia/oppia/milestones/DevOps","labels_url":"https://api.github.com/repos/oppia/oppia/milestones/24/labels","id":1475402,"number":24,"title":"DevOps","description":"[bbriggs] New contributors have zero problems with installation and testing. Tests run fast.","creator":{"login":"wxyxinyu","id":5061134,"avatar_url":"https://avatars.githubusercontent.com/u/5061134?v=3","gravatar_id":"","url":"https://api.github.com/users/wxyxinyu","html_url":"https://github.com/wxyxinyu","followers_url":"https://api.github.com/users/wxyxinyu/followers","following_url":"https://api.github.com/users/wxyxinyu/following{/other_user}","gists_url":"https://api.github.com/users/wxyxinyu/gists{/gist_id}","starred_url":"https://api.github.com/users/wxyxinyu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wxyxinyu/subscriptions","organizations_url":"https://api.github.com/users/wxyxinyu/orgs","repos_url":"https://api.github.com/users/wxyxinyu/repos","events_url":"https://api.github.com/users/wxyxinyu/events{/privacy}","received_events_url":"https://api.github.com/users/wxyxinyu/received_events","type":"User","site_admin":false},"open_issues":4,"closed_issues":4,"state":"open","created_at":"2015-12-28T01:10:23Z","updated_at":"2016-03-31T05:58:17Z","due_on":"2016-06-30T07:00:00Z","closed_at":null},"comments":51,"created_at":"2015-09-29T06:34:24Z","updated_at":"2016-04-02T07:16:49Z","closed_at":null,"body":"This follows on from #933 (/cc @sunu).\r\n\r\nThe current Travis-CI integration with Oppia currently includes backend and Karma tests, but it does not include Protractor integration tests. Ideally, it should include them (and test both Firefox and Chrome).\r\n\r\n@sunu has done some preliminary investigation with Saucelabs: the integrations worked fine and the tests did run. However, for some reason, the GAE server couldn't be launched at port 4445 which is the default port for the base URL of the app to be tested, and @sunu couldn't find a way to change that for Saucelabs either.\r\n\r\n@sunu suspects the problem is that we are supposed to start the app server before Travis-ci's Saucelabs integration kicks in (which is after the install step). This will probably require some refactoring of the test scripts.\r\n\r\nAlso, Saucelabs limits its free opensource offering to 5 \"channels\" per repo at a time. These channels should be auto-closed after each test run, but sometimes they fail to do so and this results in test failures because Travis failed to connect to Saucelabs because of no available channels. @sunu had to manually close the unused channels to get the tests to work.\r\n\r\n(Also, it looks like Saucelabs-Travis integration doesn't support pull requests, so we can't run integration tests for pull requests.)\r\n\r\nThe aim of this issue is, therefore, to refactor the test scripts and make the integration tests work well with Travis-CI."},"comment":{"url":"https://api.github.com/repos/oppia/oppia/issues/comments/204665104","html_url":"https://github.com/oppia/oppia/issues/995#issuecomment-204665104","issue_url":"https://api.github.com/repos/oppia/oppia/issues/995","id":204665104,"user":{"login":"MAKOSCAFEE","id":6409210,"avatar_url":"https://avatars.githubusercontent.com/u/6409210?v=3","gravatar_id":"","url":"https://api.github.com/users/MAKOSCAFEE","html_url":"https://github.com/MAKOSCAFEE","followers_url":"https://api.github.com/users/MAKOSCAFEE/followers","following_url":"https://api.github.com/users/MAKOSCAFEE/following{/other_user}","gists_url":"https://api.github.com/users/MAKOSCAFEE/gists{/gist_id}","starred_url":"https://api.github.com/users/MAKOSCAFEE/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MAKOSCAFEE/subscriptions","organizations_url":"https://api.github.com/users/MAKOSCAFEE/orgs","repos_url":"https://api.github.com/users/MAKOSCAFEE/repos","events_url":"https://api.github.com/users/MAKOSCAFEE/events{/privacy}","received_events_url":"https://api.github.com/users/MAKOSCAFEE/received_events","type":"User","site_admin":false},"created_at":"2016-04-02T07:16:49Z","updated_at":"2016-04-02T07:16:49Z","body":"yes i have tried this since yesterday and the results are the same.\r\nand:\r\n\r\n-the browser is chrome and in OSX10.11.4\r\n-i created new branch with just  updated develop branch it failed and i tried on develop branch the result are the same.\r\n- i run bash scripts/run_e2e_tests.sh\r\nI will ask this in gitter chat list  too."}}