aiatest/gaiatest/tests/test_browser_wifi.py tests/gaiatest/gaiatest/tests/contacts tests/gaiatest/gaiatest/tests/contacts/test_add_new_contact.py tests/gaiatest/gaiatest/tests/contacts/test_edit_contact.py tests/gaiatest/gaiatest/tests/contacts/test_call_contact.py tests/gaiatest/gaiatest/tests/contacts/manifest.ini tests/gaiatest/gaiatest/tests/contacts/test_sms_contact.py tests/gaiatest/gaiatest/tests/test_calculator.py tests/gaiatest/gaiatest/tests/manifest.ini tests/gaiatest/gaiatest/tests/test_calendar.py tests/gaiatest/gaiatest/tests/test_sms.py tests/gaiatest/gaiatest/runtests.py tests/gaiatest/gaiatest/testvars_template.json tests/gaiatest/README.md tests/gaiatest/setup.py tests/gaiatest/MANIFEST.in
Attachment #690565 - Attachment is obsolete: true
Attachment #690625 - Flags: review?(aki)
Whiteboard: [automation-needed-in-beta](...))? b) if we *don't* append the tests zip to the sendchange, b2g_panda.py will go red since it expects a test zip and won't find one. We might as well just sendchange if we're going to sendchange.
Attachment #690625 - Flags: review?(aki) → review+
(In reply to Aki Sasaki [:aki] from comment #85) >(...))? > Yes, I did. > b) if we *don't* append the tests zip to the sendchange, b2g_panda.py will > go red since it expects a test zip and won't find one. > You're right. > We might as well just sendchange if we're going to sendchange. I was assuming that not all branches will be generating the gaia-tests.zip since they don't all have the config.json changes. I guess we would only enable panda tests on branches that would already have the patch in it. I will remove the if statement.
== Status == * Until bug 820617 is fixed there is nothing that can be done to advance this bug Meanwhile, I'm adding tooling to deal with the pandas - bug 821380. This will also give me knowledge on how to handle the SUT agent being down - bug 815785.
mdas recommends that we update the b2g snapshot to improve reliability. I will keep track of it so we can uplift it.
Uplift story: * bug 818264 got uplifted in bug 819979 * bug 819342 got uplifted in bug 819979 * bug 821398 got landed but needs to be uplifted (will do in bug 822444) * bug 822444 needs to land and uplifted
I want to put the logic on the same place.
Attachment #694567 - Flags: review?(aki)
Comment on attachment 694567 [details] [diff] [review] put b2g test code inside of b2g_panda.py I think this works. a) since we're in mozharness, this is duplicating DeviceMixin code. However, I'm ok with this for the time being. b) we're trying to stick to PEP8 in mozharness; could you s,fileContents,file_contents,? I know it's confusing when you throw in the camelcase devicemanager code, but aiui A-Team is pushing towards PEP8 as well. c) Enhancement: for more automated goodness, we can actually verify the version + buildid in the file_contents and change buildbot status based on that. Optional; might help avoid having to dig through lots of logs to verify them, though.
Attachment #694567 - Flags: review?(aki) → review+
Comment on attachment 694567 [details] [diff] [review] put b2g test code inside of b2g_panda.py Adjusted the style. 69a398af05cc I will look as well into DeviceMixin.
Attachment #694567 - Flags: checked-in+
Comment on attachment 694568 [details] [diff] [review] check_b2g_application_ini should not live on tools anymore
Attachment #694568 - Flags: checked-in+
Whoever gets sooner to the patch. Thanks!
Attachment #694857 - Flags: review?(bugspam.Callek)
Attachment #694857 - Flags: review?(aki)
Comment on attachment 694857 [details] [diff] [review] Fix previous landing Review of attachment 694857 [details] [diff] [review]: ----------------------------------------------------------------- ::: scripts/b2g_panda.py @@ +108,5 @@ > """ > Run the Panda tests > """ > + mph = self.query_mozpool_handler() > + #self.request_url = "" I'm not a fan of commented-out code in final patches, is there a special reason to have this here?
Attachment #694857 - Flags: review?(bugspam.Callek) → review+
Comment on attachment 694857 [details] [diff] [review] Fix previous landing The comment was not to be there! Landed and fixed :)
Attachment #694857 - Flags: review?(aki) → checked-in+
I will gone next week so I better explain where things stand. In short: releng is waiting on dependent bugs I will leave a patch that would pretend to do what it is expected to be done as best as I know. Status ###### Biggest blocker: * bug 820617: Connecting to an nsIServerSocket on panda fails with NS_ERROR_OFFLINE ** philikon is investigating NOTE: As soon as bug 820671 gets fixed we might be able to run the tests (or a subset of them). Some of the dependent bugs are not blockers and/or only block a subset of the tests. Other blockers: * bug 819603: Booting on Panda often fails with wpa_driver_nl80211_driver_cmd:... ** I'm not sure if this is just to improve the likeability that a board boots up ** I assume that mozpool would keep on trying until it manages to get the board up * bug 820833: "No memory card found" in gaia apps on pandaboard ** This seems to help some specific tests to work rather than blocking the whole project * bug 821379: Pandaboard will become unresponsive after idling ** IIUC this does not hard block us * bug 822444: Update the B2G panda snapshot to include marionette on gaia-tests.zip ** this has landed on m-c and cedar ** we're waiting on approvals to uplift * bug 823122: Add settime support to Negatus (aka SUT agent version of b2g) ** IIUC this does not block us but it is needed for some tests to pass
This patch gets us as far as I can without fixing bug 824094.
Attachment #694975 - Flags: feedback?(aki)
Comment on attachment 694975 [details] [diff] [review] patch to try to run tests I think you'll have to import TBPL_WARNING as well (python will probably warn you about this when you try to run this). We may want to use an error_list for code = self.run_command(cmd) to detect issues, but if the exit code is reliable that may be sufficient. I haven't tried running this or anything, but it looks like it might work :)
Attachment #694975 - Flags: feedback?(aki) → feedback+
I managed to telnet to the 2828 port. Tomorrow morning I will try to run the tests. Blockers: * bug 825899 ** Reset the cedar repo. We only run panda jobs on Cedar. * bug 824094 ** This is where I have put my efforts to figure out how to run the tests correctly Dep bugs: * bug 820833: "No memory card found" in gaia apps on pandaboard ** This seems to help some specific tests to work rather than blocking the whole project * bug 821379: Pandaboard will become unresponsive after idling ** I understand this a little better. This could actually affect test results if we don't keep the board busy enough while running test jobs * bug 823122 & bug 825259: Add settime support to Negatus (aka SUT agent version of b2g) ** IIUC this does not block us but it is needed for some tests to pass
We're pretty much done. I want bug 826901 to be fixed before we enable these Gaia UI tests wherever is needed. I will work on that patch meanwhile. I hope we can green out the tests by