{"action":"created","issue":{"url":"https://api.github.com/repos/apache/incubator-quickstep/issues/129","repository_url":"https://api.github.com/repos/apache/incubator-quickstep","labels_url":"https://api.github.com/repos/apache/incubator-quickstep/issues/129/labels{/name}","comments_url":"https://api.github.com/repos/apache/incubator-quickstep/issues/129/comments","events_url":"https://api.github.com/repos/apache/incubator-quickstep/issues/129/events","html_url":"https://github.com/apache/incubator-quickstep/pull/129","id":187843542,"number":129,"title":"Partial inserts","user":{"login":"cramja","id":5708822,"avatar_url":"https://avatars.githubusercontent.com/u/5708822?v=3","gravatar_id":"","url":"https://api.github.com/users/cramja","html_url":"https://github.com/cramja","followers_url":"https://api.github.com/users/cramja/followers","following_url":"https://api.github.com/users/cramja/following{/other_user}","gists_url":"https://api.github.com/users/cramja/gists{/gist_id}","starred_url":"https://api.github.com/users/cramja/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cramja/subscriptions","organizations_url":"https://api.github.com/users/cramja/orgs","repos_url":"https://api.github.com/users/cramja/repos","events_url":"https://api.github.com/users/cramja/events{/privacy}","received_events_url":"https://api.github.com/users/cramja/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-11-07T22:09:15Z","updated_at":"2016-11-16T18:50:06Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/incubator-quickstep/pulls/129","html_url":"https://github.com/apache/incubator-quickstep/pull/129","diff_url":"https://github.com/apache/incubator-quickstep/pull/129.diff","patch_url":"https://github.com/apache/incubator-quickstep/pull/129.patch"},"body":"This change enables use of the PartialBulkInserts feature, an efficient implementation of which was introduced in the SplitRowStore in #100 . Most of these changes were imported from @navsan 's branch which exploited partial inserts but only implemented the storage optimization required to take advantage of them for the PackedRowStore.\r\n\r\n*Performance*\r\n\r\nWe ran SSB100 on the cloudlab machines and found that SplitRow's performance was almost exactly the same as PackedRow. `packed+split opt` includes both packed and splitrow with the copy optimization and uses both splitrow and packed row intermediate blocks. `splitrow opt ` uses only optimized splitrowstore blocks for intermediates.\r\n```\r\ntime (s)\r\n12.579     12.175          12.114\r\nno opt     splitrow opt    packed+split opt\r\n```\r\n\r\n*TPCH*\r\nThe total runtime of TPCH on a cloudlab box: `146,064` versus `165,640` for the latest.\r\nHere's the breakdown:\r\n```\r\n16,539.16\r\n619.40\r\n4,903.79\r\n2,408.61\r\n4,325.95\r\n399.81\r\n17,965.45\r\n1,705.55\r\n6,409.02\r\n6,873.65\r\n1,045.46\r\n1,661.75\r\n22,779.69\r\n812.33\r\n905.95\r\n10,479.83\r\n1,500.36\r\n27,464.26\r\n1,369.74\r\n1,203.16\r\n8,549.15\r\n6,141.90\r\n```\r\n\r\n*TODO*\r\n\r\nIn a later PR, we will remove packed rowstore as it represents unnecessary complexity.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/incubator-quickstep/issues/comments/261035780","html_url":"https://github.com/apache/incubator-quickstep/pull/129#issuecomment-261035780","issue_url":"https://api.github.com/repos/apache/incubator-quickstep/issues/129","id":261035780,"user":{"login":"cramja","id":5708822,"avatar_url":"https://avatars.githubusercontent.com/u/5708822?v=3","gravatar_id":"","url":"https://api.github.com/users/cramja","html_url":"https://github.com/cramja","followers_url":"https://api.github.com/users/cramja/followers","following_url":"https://api.github.com/users/cramja/following{/other_user}","gists_url":"https://api.github.com/users/cramja/gists{/gist_id}","starred_url":"https://api.github.com/users/cramja/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cramja/subscriptions","organizations_url":"https://api.github.com/users/cramja/orgs","repos_url":"https://api.github.com/users/cramja/repos","events_url":"https://api.github.com/users/cramja/events{/privacy}","received_events_url":"https://api.github.com/users/cramja/received_events","type":"User","site_admin":false},"created_at":"2016-11-16T18:50:06Z","updated_at":"2016-11-16T18:50:06Z","body":"@navsan could you verify these are the changes we wanted from your branch? Then I will merge, and at a later date, remove the PackedRowStore.\r\n\r\nThanks!"}}
{"actor":{"display_login":"cramja"}}