{"action":"closed","issue":{"url":"https://api.github.com/repos/postmanlabs/newman/issues/527","repository_url":"https://api.github.com/repos/postmanlabs/newman","labels_url":"https://api.github.com/repos/postmanlabs/newman/issues/527/labels{/name}","comments_url":"https://api.github.com/repos/postmanlabs/newman/issues/527/comments","events_url":"https://api.github.com/repos/postmanlabs/newman/issues/527/events","html_url":"https://github.com/postmanlabs/newman/issues/527","id":170530972,"number":527,"title":"Failing tests exit successfully","user":{"login":"bishtawi","id":721309,"avatar_url":"https://avatars.githubusercontent.com/u/721309?v=3","gravatar_id":"","url":"https://api.github.com/users/bishtawi","html_url":"https://github.com/bishtawi","followers_url":"https://api.github.com/users/bishtawi/followers","following_url":"https://api.github.com/users/bishtawi/following{/other_user}","gists_url":"https://api.github.com/users/bishtawi/gists{/gist_id}","starred_url":"https://api.github.com/users/bishtawi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bishtawi/subscriptions","organizations_url":"https://api.github.com/users/bishtawi/orgs","repos_url":"https://api.github.com/users/bishtawi/repos","events_url":"https://api.github.com/users/bishtawi/events{/privacy}","received_events_url":"https://api.github.com/users/bishtawi/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/postmanlabs/newman/labels/bug","name":"bug","color":"fc2929"},{"url":"https://api.github.com/repos/postmanlabs/newman/labels/pending-close","name":"pending-close","color":"e99695"},{"url":"https://api.github.com/repos/postmanlabs/newman/labels/v3","name":"v3","color":"bfd4f2"}],"state":"closed","locked":false,"assignee":{"login":"kunagpal","id":7289840,"avatar_url":"https://avatars.githubusercontent.com/u/7289840?v=3","gravatar_id":"","url":"https://api.github.com/users/kunagpal","html_url":"https://github.com/kunagpal","followers_url":"https://api.github.com/users/kunagpal/followers","following_url":"https://api.github.com/users/kunagpal/following{/other_user}","gists_url":"https://api.github.com/users/kunagpal/gists{/gist_id}","starred_url":"https://api.github.com/users/kunagpal/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kunagpal/subscriptions","organizations_url":"https://api.github.com/users/kunagpal/orgs","repos_url":"https://api.github.com/users/kunagpal/repos","events_url":"https://api.github.com/users/kunagpal/events{/privacy}","received_events_url":"https://api.github.com/users/kunagpal/received_events","type":"User","site_admin":false},"assignees":[{"login":"kunagpal","id":7289840,"avatar_url":"https://avatars.githubusercontent.com/u/7289840?v=3","gravatar_id":"","url":"https://api.github.com/users/kunagpal","html_url":"https://github.com/kunagpal","followers_url":"https://api.github.com/users/kunagpal/followers","following_url":"https://api.github.com/users/kunagpal/following{/other_user}","gists_url":"https://api.github.com/users/kunagpal/gists{/gist_id}","starred_url":"https://api.github.com/users/kunagpal/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kunagpal/subscriptions","organizations_url":"https://api.github.com/users/kunagpal/orgs","repos_url":"https://api.github.com/users/kunagpal/repos","events_url":"https://api.github.com/users/kunagpal/events{/privacy}","received_events_url":"https://api.github.com/users/kunagpal/received_events","type":"User","site_admin":false}],"milestone":{"url":"https://api.github.com/repos/postmanlabs/newman/milestones/3","html_url":"https://github.com/postmanlabs/newman/milestones/v3.1","labels_url":"https://api.github.com/repos/postmanlabs/newman/milestones/3/labels","id":1934871,"number":3,"title":"v3.1","description":"- better readme (API moving to REFERENCE.md)\r\n- comprehensive and finessed reporter outputs\r\n- proxy support\r\n- cookie jar support\r\n- client side ssl certificate support","creator":{"login":"shamasis","id":232373,"avatar_url":"https://avatars.githubusercontent.com/u/232373?v=3","gravatar_id":"","url":"https://api.github.com/users/shamasis","html_url":"https://github.com/shamasis","followers_url":"https://api.github.com/users/shamasis/followers","following_url":"https://api.github.com/users/shamasis/following{/other_user}","gists_url":"https://api.github.com/users/shamasis/gists{/gist_id}","starred_url":"https://api.github.com/users/shamasis/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shamasis/subscriptions","organizations_url":"https://api.github.com/users/shamasis/orgs","repos_url":"https://api.github.com/users/shamasis/repos","events_url":"https://api.github.com/users/shamasis/events{/privacy}","received_events_url":"https://api.github.com/users/shamasis/received_events","type":"User","site_admin":false},"open_issues":4,"closed_issues":3,"state":"open","created_at":"2016-08-10T14:35:01Z","updated_at":"2016-08-16T08:52:40Z","due_on":"2016-08-25T00:00:00Z","closed_at":null},"comments":7,"created_at":"2016-08-10T22:10:19Z","updated_at":"2016-08-16T08:52:40Z","closed_at":"2016-08-16T08:52:40Z","body":"I have newman v3.0.0 installed globally. I am executing newman from the commandline using:\r\n`newman run ContractsAPI.postman_collection -e DEV_QA_User.postman_environment`\r\n\r\nI get this assertion failure:\r\n```\r\n  #  failure                         detail                                                                                                                       \r\n                                                                                                                                                                  \r\n 1⠄  AssertionFailure                Response time is less than 200ms                                                                                             \r\n                                     at assertion:1 in test-script                                                                                                \r\n                                     inside \"Contracts - Valid contract commit.\" of \"Contracts APIs\"   \r\n```\r\n\r\nBut newman exits with the successful exit code of 0. I am not passing in `-x`, `--suppress-exit-code`, or `--bail`. I would expect a failing exit code (like 1)."}}
{"actor":{"display_login":"kunagpal"}}