{"action":"created","issue":{"url":"https://api.github.com/repos/ipfs/js-ipfs/issues/674","repository_url":"https://api.github.com/repos/ipfs/js-ipfs","labels_url":"https://api.github.com/repos/ipfs/js-ipfs/issues/674/labels{/name}","comments_url":"https://api.github.com/repos/ipfs/js-ipfs/issues/674/comments","events_url":"https://api.github.com/repos/ipfs/js-ipfs/issues/674/events","html_url":"https://github.com/ipfs/js-ipfs/pull/674","id":196324140,"number":674,"title":"Set up interop and benchmark tests","user":{"login":"diasdavid","id":1211152,"avatar_url":"https://avatars.githubusercontent.com/u/1211152?v=3","gravatar_id":"","url":"https://api.github.com/users/diasdavid","html_url":"https://github.com/diasdavid","followers_url":"https://api.github.com/users/diasdavid/followers","following_url":"https://api.github.com/users/diasdavid/following{/other_user}","gists_url":"https://api.github.com/users/diasdavid/gists{/gist_id}","starred_url":"https://api.github.com/users/diasdavid/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/diasdavid/subscriptions","organizations_url":"https://api.github.com/users/diasdavid/orgs","repos_url":"https://api.github.com/users/diasdavid/repos","events_url":"https://api.github.com/users/diasdavid/events{/privacy}","received_events_url":"https://api.github.com/users/diasdavid/received_events","type":"User","site_admin":false},"labels":[{"id":259619775,"url":"https://api.github.com/repos/ipfs/js-ipfs/labels/in%20progress","name":"in progress","color":"ededed","default":false}],"state":"open","locked":false,"assignee":{"login":"dignifiedquire","id":790842,"avatar_url":"https://avatars.githubusercontent.com/u/790842?v=3","gravatar_id":"","url":"https://api.github.com/users/dignifiedquire","html_url":"https://github.com/dignifiedquire","followers_url":"https://api.github.com/users/dignifiedquire/followers","following_url":"https://api.github.com/users/dignifiedquire/following{/other_user}","gists_url":"https://api.github.com/users/dignifiedquire/gists{/gist_id}","starred_url":"https://api.github.com/users/dignifiedquire/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dignifiedquire/subscriptions","organizations_url":"https://api.github.com/users/dignifiedquire/orgs","repos_url":"https://api.github.com/users/dignifiedquire/repos","events_url":"https://api.github.com/users/dignifiedquire/events{/privacy}","received_events_url":"https://api.github.com/users/dignifiedquire/received_events","type":"User","site_admin":false},"assignees":[{"login":"dignifiedquire","id":790842,"avatar_url":"https://avatars.githubusercontent.com/u/790842?v=3","gravatar_id":"","url":"https://api.github.com/users/dignifiedquire","html_url":"https://github.com/dignifiedquire","followers_url":"https://api.github.com/users/dignifiedquire/followers","following_url":"https://api.github.com/users/dignifiedquire/following{/other_user}","gists_url":"https://api.github.com/users/dignifiedquire/gists{/gist_id}","starred_url":"https://api.github.com/users/dignifiedquire/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dignifiedquire/subscriptions","organizations_url":"https://api.github.com/users/dignifiedquire/orgs","repos_url":"https://api.github.com/users/dignifiedquire/repos","events_url":"https://api.github.com/users/dignifiedquire/events{/privacy}","received_events_url":"https://api.github.com/users/dignifiedquire/received_events","type":"User","site_admin":false},{"login":"diasdavid","id":1211152,"avatar_url":"https://avatars.githubusercontent.com/u/1211152?v=3","gravatar_id":"","url":"https://api.github.com/users/diasdavid","html_url":"https://github.com/diasdavid","followers_url":"https://api.github.com/users/diasdavid/followers","following_url":"https://api.github.com/users/diasdavid/following{/other_user}","gists_url":"https://api.github.com/users/diasdavid/gists{/gist_id}","starred_url":"https://api.github.com/users/diasdavid/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/diasdavid/subscriptions","organizations_url":"https://api.github.com/users/diasdavid/orgs","repos_url":"https://api.github.com/users/diasdavid/repos","events_url":"https://api.github.com/users/diasdavid/events{/privacy}","received_events_url":"https://api.github.com/users/diasdavid/received_events","type":"User","site_admin":false}],"milestone":null,"comments":6,"created_at":"2016-12-19T03:28:32Z","updated_at":"2016-12-23T07:44:06Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/ipfs/js-ipfs/pulls/674","html_url":"https://github.com/ipfs/js-ipfs/pull/674","diff_url":"https://github.com/ipfs/js-ipfs/pull/674.diff","patch_url":"https://github.com/ipfs/js-ipfs/pull/674.patch"},"body":"I want to set up `interop` and `benchmark` tests that are run pre-release of js-ipfs (or any time a dev wants), while the `unit` tests are run in the CI always.\r\n\r\nI also would love to make sure that `benchmark` tests produce something parseable (text or json) so that we can generate graphs in the future and that `aegir-release` adds them to a `benchmarks` folder with the date and hour of the release, so that we can graph it evolving over time.\r\n\r\nThis is the first step towards a more robust implementation js-ipfs. The second step will be 'mad network topologies configurations' on https://github.com/ipfs/ipfs-interop-stress-tests.\r\n\r\n@dignifiedquire what is the best way to achieve this with `aegir`, 'this' being:\r\n\r\n- setting up `npm test` only running the `unit` tests\r\n- set up the benchmarks to generate something that gets added with the release process"},"comment":{"url":"https://api.github.com/repos/ipfs/js-ipfs/issues/comments/268952071","html_url":"https://github.com/ipfs/js-ipfs/pull/674#issuecomment-268952071","issue_url":"https://api.github.com/repos/ipfs/js-ipfs/issues/674","id":268952071,"user":{"login":"diasdavid","id":1211152,"avatar_url":"https://avatars.githubusercontent.com/u/1211152?v=3","gravatar_id":"","url":"https://api.github.com/users/diasdavid","html_url":"https://github.com/diasdavid","followers_url":"https://api.github.com/users/diasdavid/followers","following_url":"https://api.github.com/users/diasdavid/following{/other_user}","gists_url":"https://api.github.com/users/diasdavid/gists{/gist_id}","starred_url":"https://api.github.com/users/diasdavid/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/diasdavid/subscriptions","organizations_url":"https://api.github.com/users/diasdavid/orgs","repos_url":"https://api.github.com/users/diasdavid/repos","events_url":"https://api.github.com/users/diasdavid/events{/privacy}","received_events_url":"https://api.github.com/users/diasdavid/received_events","type":"User","site_admin":false},"created_at":"2016-12-23T07:44:06Z","updated_at":"2016-12-23T07:44:06Z","body":"@dignifiedquire tests are failing in this PR (even with deps updated) silently:\r\n\r\n```\r\nnpm test\r\n\r\n\r\n> ipfs@0.20.3 test /home/ubuntu/js-ipfs\r\n> gulp test\r\n\r\n[07:41:46] Using gulpfile ~/js-ipfs/gulpfile.js\r\n[07:41:46] Starting 'test'...\r\n[07:41:46] Starting 'test:node'...\r\n[07:41:46] Starting 'libnode:start'...\r\nStarting at /tmp/ipfs-test-081107\r\nStarting at /tmp/ipfs-test-727825\r\nStarting at /tmp/ipfs-test-078677\r\nStarting at /tmp/ipfs-test-348420\r\nSwarm listening on /ip4/127.0.0.1/tcp/20012/ws\r\nSwarm listening on /ip4/127.0.0.1/tcp/10012\r\nnpm ERR! Test failed.  See above for more details.\r\n\r\nnpm test returned exit code 1\r\n```"}}
{"actor":{"display_login":"diasdavid"}}