{"action":"created","issue":{"url":"https://api.github.com/repos/infinispan/infinispan/issues/5765","repository_url":"https://api.github.com/repos/infinispan/infinispan","labels_url":"https://api.github.com/repos/infinispan/infinispan/issues/5765/labels{/name}","comments_url":"https://api.github.com/repos/infinispan/infinispan/issues/5765/comments","events_url":"https://api.github.com/repos/infinispan/infinispan/issues/5765/events","html_url":"https://github.com/infinispan/infinispan/pull/5765","id":297764924,"number":5765,"title":"ISPN-8822 Performance degradation when running Spark jobs","user":{"login":"gustavonalle","id":440989,"avatar_url":"https://avatars2.githubusercontent.com/u/440989?v=4","gravatar_id":"","url":"https://api.github.com/users/gustavonalle","html_url":"https://github.com/gustavonalle","followers_url":"https://api.github.com/users/gustavonalle/followers","following_url":"https://api.github.com/users/gustavonalle/following{/other_user}","gists_url":"https://api.github.com/users/gustavonalle/gists{/gist_id}","starred_url":"https://api.github.com/users/gustavonalle/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gustavonalle/subscriptions","organizations_url":"https://api.github.com/users/gustavonalle/orgs","repos_url":"https://api.github.com/users/gustavonalle/repos","events_url":"https://api.github.com/users/gustavonalle/events{/privacy}","received_events_url":"https://api.github.com/users/gustavonalle/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/infinispan/infinispan/milestones/96","html_url":"https://github.com/infinispan/infinispan/milestone/96","labels_url":"https://api.github.com/repos/infinispan/infinispan/milestones/96/labels","id":3110885,"number":96,"title":"9.2.0.CR3","description":null,"creator":{"login":"anistor","id":995864,"avatar_url":"https://avatars0.githubusercontent.com/u/995864?v=4","gravatar_id":"","url":"https://api.github.com/users/anistor","html_url":"https://github.com/anistor","followers_url":"https://api.github.com/users/anistor/followers","following_url":"https://api.github.com/users/anistor/following{/other_user}","gists_url":"https://api.github.com/users/anistor/gists{/gist_id}","starred_url":"https://api.github.com/users/anistor/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/anistor/subscriptions","organizations_url":"https://api.github.com/users/anistor/orgs","repos_url":"https://api.github.com/users/anistor/repos","events_url":"https://api.github.com/users/anistor/events{/privacy}","received_events_url":"https://api.github.com/users/anistor/received_events","type":"User","site_admin":false},"open_issues":3,"closed_issues":7,"state":"open","created_at":"2018-02-13T10:49:18Z","updated_at":"2018-02-21T09:39:39Z","due_on":null,"closed_at":null},"comments":24,"created_at":"2018-02-16T12:08:56Z","updated_at":"2018-02-21T09:50:28Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/infinispan/infinispan/pulls/5765","html_url":"https://github.com/infinispan/infinispan/pull/5765","diff_url":"https://github.com/infinispan/infinispan/pull/5765.diff","patch_url":"https://github.com/infinispan/infinispan/pull/5765.patch"},"body":"https://issues.jboss.org/browse/ISPN-8822\r\n\r\nSome numbers from my local environment:\r\n\r\n| Method| 9.2.0.CR1 (ms) | 9.2.0.CR2 (ms)| \r\n| --- |---| ---|\r\n| ingestion|6873|25323|\r\n| iteration|377|2570|\r\n\r\nThe iteration method is a single client/single server iterating through all entries and closing the remote cache manager (like the Spark connector does). As explained in the JIRA, CR2 adds a 2s constant delay in closing the cache manager, so this should account for most of the discrepancy\r\n\r\nWith relation to data ingestion, was not expecting such a difference...\r\n"},"comment":{"url":"https://api.github.com/repos/infinispan/infinispan/issues/comments/367270205","html_url":"https://github.com/infinispan/infinispan/pull/5765#issuecomment-367270205","issue_url":"https://api.github.com/repos/infinispan/infinispan/issues/5765","id":367270205,"user":{"login":"gustavonalle","id":440989,"avatar_url":"https://avatars2.githubusercontent.com/u/440989?v=4","gravatar_id":"","url":"https://api.github.com/users/gustavonalle","html_url":"https://github.com/gustavonalle","followers_url":"https://api.github.com/users/gustavonalle/followers","following_url":"https://api.github.com/users/gustavonalle/following{/other_user}","gists_url":"https://api.github.com/users/gustavonalle/gists{/gist_id}","starred_url":"https://api.github.com/users/gustavonalle/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gustavonalle/subscriptions","organizations_url":"https://api.github.com/users/gustavonalle/orgs","repos_url":"https://api.github.com/users/gustavonalle/repos","events_url":"https://api.github.com/users/gustavonalle/events{/privacy}","received_events_url":"https://api.github.com/users/gustavonalle/received_events","type":"User","site_admin":false},"created_at":"2018-02-21T09:50:28Z","updated_at":"2018-02-21T09:50:28Z","author_association":"CONTRIBUTOR","body":"This PR can be reviewed and merged \"as is\", since it removes the 2s wait when closing the cache manager that hurts small spark jobs.  We can carry on the perf work in separate JIRAs"}}
{"actor":{"display_login":"gustavonalle"}}