{"action":"created","issue":{"url":"https://api.github.com/repos/catapult-project/catapult/issues/2645","repository_url":"https://api.github.com/repos/catapult-project/catapult","labels_url":"https://api.github.com/repos/catapult-project/catapult/issues/2645/labels{/name}","comments_url":"https://api.github.com/repos/catapult-project/catapult/issues/2645/comments","events_url":"https://api.github.com/repos/catapult-project/catapult/issues/2645/events","html_url":"https://github.com/catapult-project/catapult/issues/2645","id":170422874,"number":2645,"title":"Catapult Android tryserver doesn't run Android telemetry tests","user":{"login":"zeptonaut","id":1407397,"avatar_url":"https://avatars.githubusercontent.com/u/1407397?v=3","gravatar_id":"","url":"https://api.github.com/users/zeptonaut","html_url":"https://github.com/zeptonaut","followers_url":"https://api.github.com/users/zeptonaut/followers","following_url":"https://api.github.com/users/zeptonaut/following{/other_user}","gists_url":"https://api.github.com/users/zeptonaut/gists{/gist_id}","starred_url":"https://api.github.com/users/zeptonaut/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zeptonaut/subscriptions","organizations_url":"https://api.github.com/users/zeptonaut/orgs","repos_url":"https://api.github.com/users/zeptonaut/repos","events_url":"https://api.github.com/users/zeptonaut/events{/privacy}","received_events_url":"https://api.github.com/users/zeptonaut/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/catapult-project/catapult/labels/Bug","name":"Bug","color":"fc2929"},{"url":"https://api.github.com/repos/catapult-project/catapult/labels/Infrastructure","name":"Infrastructure","color":"bfe5bf"},{"url":"https://api.github.com/repos/catapult-project/catapult/labels/P1","name":"P1","color":"eb6420"}],"state":"open","locked":false,"assignee":{"login":"zeptonaut","id":1407397,"avatar_url":"https://avatars.githubusercontent.com/u/1407397?v=3","gravatar_id":"","url":"https://api.github.com/users/zeptonaut","html_url":"https://github.com/zeptonaut","followers_url":"https://api.github.com/users/zeptonaut/followers","following_url":"https://api.github.com/users/zeptonaut/following{/other_user}","gists_url":"https://api.github.com/users/zeptonaut/gists{/gist_id}","starred_url":"https://api.github.com/users/zeptonaut/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zeptonaut/subscriptions","organizations_url":"https://api.github.com/users/zeptonaut/orgs","repos_url":"https://api.github.com/users/zeptonaut/repos","events_url":"https://api.github.com/users/zeptonaut/events{/privacy}","received_events_url":"https://api.github.com/users/zeptonaut/received_events","type":"User","site_admin":false},"assignees":[{"login":"zeptonaut","id":1407397,"avatar_url":"https://avatars.githubusercontent.com/u/1407397?v=3","gravatar_id":"","url":"https://api.github.com/users/zeptonaut","html_url":"https://github.com/zeptonaut","followers_url":"https://api.github.com/users/zeptonaut/followers","following_url":"https://api.github.com/users/zeptonaut/following{/other_user}","gists_url":"https://api.github.com/users/zeptonaut/gists{/gist_id}","starred_url":"https://api.github.com/users/zeptonaut/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zeptonaut/subscriptions","organizations_url":"https://api.github.com/users/zeptonaut/orgs","repos_url":"https://api.github.com/users/zeptonaut/repos","events_url":"https://api.github.com/users/zeptonaut/events{/privacy}","received_events_url":"https://api.github.com/users/zeptonaut/received_events","type":"User","site_admin":false},{"login":"Apeliotes","id":7633415,"avatar_url":"https://avatars.githubusercontent.com/u/7633415?v=3","gravatar_id":"","url":"https://api.github.com/users/Apeliotes","html_url":"https://github.com/Apeliotes","followers_url":"https://api.github.com/users/Apeliotes/followers","following_url":"https://api.github.com/users/Apeliotes/following{/other_user}","gists_url":"https://api.github.com/users/Apeliotes/gists{/gist_id}","starred_url":"https://api.github.com/users/Apeliotes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Apeliotes/subscriptions","organizations_url":"https://api.github.com/users/Apeliotes/orgs","repos_url":"https://api.github.com/users/Apeliotes/repos","events_url":"https://api.github.com/users/Apeliotes/events{/privacy}","received_events_url":"https://api.github.com/users/Apeliotes/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/catapult-project/catapult/milestones/9","html_url":"https://github.com/catapult-project/catapult/milestones/M54","labels_url":"https://api.github.com/repos/catapult-project/catapult/milestones/9/labels","id":1841113,"number":9,"title":"M54","description":"","creator":{"login":"zeptonaut","id":1407397,"avatar_url":"https://avatars.githubusercontent.com/u/1407397?v=3","gravatar_id":"","url":"https://api.github.com/users/zeptonaut","html_url":"https://github.com/zeptonaut","followers_url":"https://api.github.com/users/zeptonaut/followers","following_url":"https://api.github.com/users/zeptonaut/following{/other_user}","gists_url":"https://api.github.com/users/zeptonaut/gists{/gist_id}","starred_url":"https://api.github.com/users/zeptonaut/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zeptonaut/subscriptions","organizations_url":"https://api.github.com/users/zeptonaut/orgs","repos_url":"https://api.github.com/users/zeptonaut/repos","events_url":"https://api.github.com/users/zeptonaut/events{/privacy}","received_events_url":"https://api.github.com/users/zeptonaut/received_events","type":"User","site_admin":false},"open_issues":28,"closed_issues":36,"state":"open","created_at":"2016-06-21T17:23:13Z","updated_at":"2016-08-19T15:49:02Z","due_on":"2016-08-25T04:00:00Z","closed_at":null},"comments":24,"created_at":"2016-08-10T13:54:07Z","updated_at":"2016-08-19T19:10:55Z","closed_at":null,"body":"When I tried to run a new test that ran only on Android:\r\n\r\n```python\r\n@decorators.Enabled('android')\r\ndef testClockSyncAtrace(self):\r\n  ps = self.CreateEmptyPageSet()\r\n  ps.AddStory(TestTimelinebasedMeasurementPage(ps, ps.base_dir))\r\n\r\n  options = tbm_module.Options()\r\n  options.config.enable_atrace_trace = True\r\n  options.config.enable_chrome_trace = True\r\n  options.config.chrome_trace_config.SetDefaultOverheadFilter()\r\n  options.SetTimelineBasedMetrics(['clockSyncLatencyMetric'])\r\n\r\n  tbm = tbm_module.TimelineBasedMeasurement(options)\r\n  results = self.RunMeasurement(tbm, ps, self._options)\r\n\r\n  self.assertEquals(0, len(results.failures))\r\n```\r\n\r\non the Catapult Android tryserver, I got the STDOUT message:\r\n\r\n```\r\n[79/1095] telemetry.web_perf.timeline_based_page_test_unittest.TimelineBasedPageTestTest.testClockSyncAtrace was skipped 0.0000s:\r\n  Skipping testClockSyncAtrace (<bound method TimelineBasedPageTestTest.testClockSyncAtrace of <telemetry.web_perf.timeline_based_page_test_unittest.TimelineBasedPageTestTest testMethod=testClockSyncAtrace>>) because it is only enabled for android. You are running ['reference', 'linux', 'trusty', 'has tabs', 'linux-reference', 'trusty-reference', 'has tabs-reference'].\r\n```\r\n\r\nwhich seemed to suggest that no Android tests had *ever* run on the tryserver. @nedn confirmed this fear after looking at the logs.\r\n\r\nHe pointed out that the problem lie with the command that we're using to run the Catapult tests on Android:\r\n\r\n```\r\npython /b/build/slave/catapult/build/catapult/telemetry/bin/run_tests '--browser=reference' --start-xvfb\r\n```\r\n\r\nIn order for these tests to run on Android, we need:\r\n\r\n```\r\npython /b/build/slave/catapult/build/catapult/telemetry/bin/run_tests '--browser=reference'  --device=android --start-xvfb\r\n```\r\n\r\nThis will require a recipe change, and will likely end up with fixing a bunch of tests that were broken because they haven't been run successfully on Android."},"comment":{"url":"https://api.github.com/repos/catapult-project/catapult/issues/comments/241108687","html_url":"https://github.com/catapult-project/catapult/issues/2645#issuecomment-241108687","issue_url":"https://api.github.com/repos/catapult-project/catapult/issues/2645","id":241108687,"user":{"login":"zeptonaut","id":1407397,"avatar_url":"https://avatars.githubusercontent.com/u/1407397?v=3","gravatar_id":"","url":"https://api.github.com/users/zeptonaut","html_url":"https://github.com/zeptonaut","followers_url":"https://api.github.com/users/zeptonaut/followers","following_url":"https://api.github.com/users/zeptonaut/following{/other_user}","gists_url":"https://api.github.com/users/zeptonaut/gists{/gist_id}","starred_url":"https://api.github.com/users/zeptonaut/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zeptonaut/subscriptions","organizations_url":"https://api.github.com/users/zeptonaut/orgs","repos_url":"https://api.github.com/users/zeptonaut/repos","events_url":"https://api.github.com/users/zeptonaut/events{/privacy}","received_events_url":"https://api.github.com/users/zeptonaut/received_events","type":"User","site_admin":false},"created_at":"2016-08-19T19:10:55Z","updated_at":"2016-08-19T19:10:55Z","body":"/cry\r\n\r\n@jbudorick, is there any chance you could be a lifesaver and help with this one too?"}}
{"actor":{"display_login":"zeptonaut"}}