{"action":"created","issue":{"url":"https://api.github.com/repos/apache/cloudstack/issues/1525","repository_url":"https://api.github.com/repos/apache/cloudstack","labels_url":"https://api.github.com/repos/apache/cloudstack/issues/1525/labels{/name}","comments_url":"https://api.github.com/repos/apache/cloudstack/issues/1525/comments","events_url":"https://api.github.com/repos/apache/cloudstack/issues/1525/events","html_url":"https://github.com/apache/cloudstack/pull/1525","id":152342464,"number":1525,"title":"Status of tests","user":{"login":"swill","id":13644,"avatar_url":"https://avatars.githubusercontent.com/u/13644?v=3","gravatar_id":"","url":"https://api.github.com/users/swill","html_url":"https://github.com/swill","followers_url":"https://api.github.com/users/swill/followers","following_url":"https://api.github.com/users/swill/following{/other_user}","gists_url":"https://api.github.com/users/swill/gists{/gist_id}","starred_url":"https://api.github.com/users/swill/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/swill/subscriptions","organizations_url":"https://api.github.com/users/swill/orgs","repos_url":"https://api.github.com/users/swill/repos","events_url":"https://api.github.com/users/swill/events{/privacy}","received_events_url":"https://api.github.com/users/swill/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2016-05-01T18:46:28Z","updated_at":"2016-05-03T14:57:58Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/cloudstack/pulls/1525","html_url":"https://github.com/apache/cloudstack/pull/1525","diff_url":"https://github.com/apache/cloudstack/pull/1525.diff","patch_url":"https://github.com/apache/cloudstack/pull/1525.patch"},"body":"This PR is not meant to be merged, but instead be able to give a point in time status of our current tests (on KVM).\r\n\r\nI have just finished a 3 day run of all of our tests in the root directory of `test/integration/smoke` and `test/integration/component` which I will be posting to this PR.  \r\n\r\nThe purpose of posting these results is to help everyone understand what tests are having problems and we will hopefully be able to find a relatively comprehensive set of tests that we can run on every PR.  I don't think running all the tests on every PR is realistic considering it took 3 days to run all these tests. \r\n\r\nNext I will be pulling out all of the failed tests and building in some logic to time each of the tests so I can figure out which tests are taking the longest to run.  I will also be looking into ways of parallelizing these tests. \r\n\r\nAnyway, here is a start..."},"comment":{"url":"https://api.github.com/repos/apache/cloudstack/issues/comments/216555503","html_url":"https://github.com/apache/cloudstack/pull/1525#issuecomment-216555503","issue_url":"https://api.github.com/repos/apache/cloudstack/issues/1525","id":216555503,"user":{"login":"swill","id":13644,"avatar_url":"https://avatars.githubusercontent.com/u/13644?v=3","gravatar_id":"","url":"https://api.github.com/users/swill","html_url":"https://github.com/swill","followers_url":"https://api.github.com/users/swill/followers","following_url":"https://api.github.com/users/swill/following{/other_user}","gists_url":"https://api.github.com/users/swill/gists{/gist_id}","starred_url":"https://api.github.com/users/swill/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/swill/subscriptions","organizations_url":"https://api.github.com/users/swill/orgs","repos_url":"https://api.github.com/users/swill/repos","events_url":"https://api.github.com/users/swill/events{/privacy}","received_events_url":"https://api.github.com/users/swill/received_events","type":"User","site_admin":false},"created_at":"2016-05-03T14:57:58Z","updated_at":"2016-05-03T14:57:58Z","body":"A few more details.\r\n\r\nThe full run took: `55h 59m 30s`\r\n\r\nThe following tests took longer than an hour to complete:\r\n```\r\n1h 01m 46s => /tmp/MarvinLogs/test_resource_limits_NXZ78Y\r\n4h 27m 45s => /tmp/MarvinLogs/test_shared_networks_DKG901\r\n1h 17m 39s => /tmp/MarvinLogs/test_portable_ip_19JH7D\r\n2h 04m 22s => /tmp/MarvinLogs/test_stopped_vm_U32ILW\r\n1h 04m 40s => /tmp/MarvinLogs/test_escalations_instances_VGGKIS\r\n1h 44m 23s => /tmp/MarvinLogs/test_persistent_networks_SA4CJC\r\n1h 03m 11s => /tmp/MarvinLogs/test_vpc_network_pfrules_OF7F63\r\n2h 01m 12s => /tmp/MarvinLogs/test_snapshot_limits_6XF7FG\r\n1h 12m 14s => /tmp/MarvinLogs/test_deploy_vm_iso_34RU69\r\n8h 01m 51s => /tmp/MarvinLogs/test_recurring_snapshots_UVBKKN\r\n1h 33m 25s => /tmp/MarvinLogs/test_base_image_updation_EC1K1N\r\n1h 17m 57s => /tmp/MarvinLogs/test_affinity_groups_00G23N\r\n1h 21m 59s => /tmp/MarvinLogs/test_multiple_ips_per_nic_MYZJWD\r\n```\r\n\r\nObviously the recurring snapshots test can be improved.  Also, the shared network tests seem to take a pretty long time as well.  Not sure why it took 2 hours to test stopped vm, that seems a bit odd.  \r\n\r\nAll said, we have some areas for improvement here..."}}