{"action":"created","issue":{"url":"https://api.github.com/repos/ably/ably-java/issues/159","repository_url":"https://api.github.com/repos/ably/ably-java","labels_url":"https://api.github.com/repos/ably/ably-java/issues/159/labels{/name}","comments_url":"https://api.github.com/repos/ably/ably-java/issues/159/comments","events_url":"https://api.github.com/repos/ably/ably-java/issues/159/events","html_url":"https://github.com/ably/ably-java/issues/159","id":176379489,"number":159,"title":"Test failing on Travis (JDK7, JDK8, Android)","user":{"login":"dsvishchov","id":885649,"avatar_url":"https://avatars.githubusercontent.com/u/885649?v=3","gravatar_id":"","url":"https://api.github.com/users/dsvishchov","html_url":"https://github.com/dsvishchov","followers_url":"https://api.github.com/users/dsvishchov/followers","following_url":"https://api.github.com/users/dsvishchov/following{/other_user}","gists_url":"https://api.github.com/users/dsvishchov/gists{/gist_id}","starred_url":"https://api.github.com/users/dsvishchov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dsvishchov/subscriptions","organizations_url":"https://api.github.com/users/dsvishchov/orgs","repos_url":"https://api.github.com/users/dsvishchov/repos","events_url":"https://api.github.com/users/dsvishchov/events{/privacy}","received_events_url":"https://api.github.com/users/dsvishchov/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/ably/ably-java/labels/ci%20issue","name":"ci issue","color":"fbca04"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":15,"created_at":"2016-09-12T13:46:55Z","updated_at":"2016-10-27T16:40:25Z","closed_at":null,"body":"As per discussion with @mattheworiordan adding this ticket for further investigation of various fails of tests on Travis (and sometimes locally) for all 3 environments (JDK7, JDK8, Android).\r\n\r\nOut latest fixes for JDK7, JDK8 available in a separate branch:\r\nhttps://github.com/ably/ably-java/tree/fix-tests\r\n\r\nAnd associated latest Travis build:\r\nhttps://travis-ci.org/ably/ably-java/builds/159298940\r\n\r\nThe only one thing we actually did is added delays before checking test results (in a way we already found in other tests already written) and most of issues gone, but:\r\n\r\n1) there are still some tests which fail from time to time (which I think we need to discuss here once happens);\r\n2) now it runs properly on JDK7, and stuck for 10 mins on JDK8 (and Travis ends job due to that), there two things to think about: a) from my point of view all test should be written in a way they don't stuck forever but rather fail with timeout exception; b) why it runs on JDK7 properly and fails on JDK8 (just to understand the nature of failing);\r\n3) why do they run properly in most cases when ran locally?\r\n\r\nWe might definitely dive deeper into details but since you have more knowledge and experience in how library works and how tests were written it should be much more efficient if you can review and investigate.\r\n\r\nBtw, latest Jenkins build succeeded:\r\n> Jenkins build is back to normal : ably-java #239\r\n> See <https://ci.ably.io/job/ably-java/239/>\r\n\r\nOut latest fixes to make Android tests run (both core tests and an example of Android specific test) available in a separate branch:\r\nhttps://github.com/ably/ably-java/commits/project-struct-update\r\n\r\nAnd associated latest Travis build:\r\nhttps://travis-ci.org/ably/ably-java/builds/159307979 \r\n\r\nWe didn't merge changes we did for regular Java tests, and also temporarily added @Ignore to one test which suspended tests execution. \r\n\r\nCouple of things to discuss/investigate:\r\n\r\n1) currently it runs tests twice (> Starting 595 tests on test(AVD) - 5.1), this needs to be fixed;\r\n2) there are still around 30 tests which are failing and require to be either fixed or removed from the execution list for Android (see Travis logs for more details).\r\n\r\nAnd finally... There is still magic happens since some tests fail from time to time and even the ones we added delays for mostly ran properly (for example in the latest Travis build for Android which also runs regular tests) but sometimes failed."},"comment":{"url":"https://api.github.com/repos/ably/ably-java/issues/comments/256700414","html_url":"https://github.com/ably/ably-java/issues/159#issuecomment-256700414","issue_url":"https://api.github.com/repos/ably/ably-java/issues/159","id":256700414,"user":{"login":"trenouf","id":5879367,"avatar_url":"https://avatars.githubusercontent.com/u/5879367?v=3","gravatar_id":"","url":"https://api.github.com/users/trenouf","html_url":"https://github.com/trenouf","followers_url":"https://api.github.com/users/trenouf/followers","following_url":"https://api.github.com/users/trenouf/following{/other_user}","gists_url":"https://api.github.com/users/trenouf/gists{/gist_id}","starred_url":"https://api.github.com/users/trenouf/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/trenouf/subscriptions","organizations_url":"https://api.github.com/users/trenouf/orgs","repos_url":"https://api.github.com/users/trenouf/repos","events_url":"https://api.github.com/users/trenouf/events{/privacy}","received_events_url":"https://api.github.com/users/trenouf/received_events","type":"User","site_admin":false},"created_at":"2016-10-27T16:40:25Z","updated_at":"2016-10-27T16:40:25Z","body":"I don't think I fully understand what it's trying to do then. More news later."}}
{"actor":{"display_login":"trenouf"}}