{"action":"created","issue":{"url":"https://api.github.com/repos/numpy/numpy/issues/10776","repository_url":"https://api.github.com/repos/numpy/numpy","labels_url":"https://api.github.com/repos/numpy/numpy/issues/10776/labels{/name}","comments_url":"https://api.github.com/repos/numpy/numpy/issues/10776/comments","events_url":"https://api.github.com/repos/numpy/numpy/issues/10776/events","html_url":"https://github.com/numpy/numpy/issues/10776","id":307133176,"node_id":"MDU6SXNzdWUzMDcxMzMxNzY=","number":10776,"title":"savez fails on large array of objects","user":{"login":"pkomiske","id":19966115,"node_id":"MDQ6VXNlcjE5OTY2MTE1","avatar_url":"https://avatars0.githubusercontent.com/u/19966115?v=4","gravatar_id":"","url":"https://api.github.com/users/pkomiske","html_url":"https://github.com/pkomiske","followers_url":"https://api.github.com/users/pkomiske/followers","following_url":"https://api.github.com/users/pkomiske/following{/other_user}","gists_url":"https://api.github.com/users/pkomiske/gists{/gist_id}","starred_url":"https://api.github.com/users/pkomiske/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pkomiske/subscriptions","organizations_url":"https://api.github.com/users/pkomiske/orgs","repos_url":"https://api.github.com/users/pkomiske/repos","events_url":"https://api.github.com/users/pkomiske/events{/privacy}","received_events_url":"https://api.github.com/users/pkomiske/received_events","type":"User","site_admin":false},"labels":[{"id":30180279,"node_id":"MDU6TGFiZWwzMDE4MDI3OQ==","url":"https://api.github.com/repos/numpy/numpy/labels/54%20-%20Needs%20decision","name":"54 - Needs decision","color":"207de5","default":false}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/numpy/numpy/milestones/62","html_url":"https://github.com/numpy/numpy/milestone/62","labels_url":"https://api.github.com/repos/numpy/numpy/milestones/62/labels","id":3633188,"node_id":"MDk6TWlsZXN0b25lMzYzMzE4OA==","number":62,"title":" 1.17.0 release","description":"","creator":{"login":"charris","id":77272,"node_id":"MDQ6VXNlcjc3Mjcy","avatar_url":"https://avatars3.githubusercontent.com/u/77272?v=4","gravatar_id":"","url":"https://api.github.com/users/charris","html_url":"https://github.com/charris","followers_url":"https://api.github.com/users/charris/followers","following_url":"https://api.github.com/users/charris/following{/other_user}","gists_url":"https://api.github.com/users/charris/gists{/gist_id}","starred_url":"https://api.github.com/users/charris/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/charris/subscriptions","organizations_url":"https://api.github.com/users/charris/orgs","repos_url":"https://api.github.com/users/charris/repos","events_url":"https://api.github.com/users/charris/events{/privacy}","received_events_url":"https://api.github.com/users/charris/received_events","type":"User","site_admin":false},"open_issues":25,"closed_issues":14,"state":"open","created_at":"2018-09-07T16:24:30Z","updated_at":"2019-03-15T21:59:07Z","due_on":null,"closed_at":null},"comments":12,"created_at":"2018-03-21T06:36:41Z","updated_at":"2019-03-18T11:52:20Z","closed_at":null,"author_association":"NONE","body":"I'm getting a RuntimeError \"File size unexpectedly exceeded ZIP64 limit\" when using `savez` to save a few arrays to a file, the largest of which is an array of matrices each with a different number of rows (so that the top level array's dtype is object). As best I can tell, the condition used by numpy internally to decide whether or not to pass `force_zip64=True` to the zipfile open is checking if any of the arrays to be put into the archive has nbytes greater than 2^30. My array of matrices reports nbytes less than 2^30 but in reality the total number of bytes exceeds this (it's about 1.7GB). I'm using python 3.6 and numpy 1.14.2 on Ubuntu 16.04. \r\n\r\nThe following code produces the error:\r\n```python\r\ntest_data = np.asarray([np.random.rand(np.random.randint(50,100),4) for i in range(800000)])\r\nnp.savez('test', test_data=test_data)\r\n```\r\nwhereas changing `np.random.randint(50,100)`->`75` produces no error."},"comment":{"url":"https://api.github.com/repos/numpy/numpy/issues/comments/473879190","html_url":"https://github.com/numpy/numpy/issues/10776#issuecomment-473879190","issue_url":"https://api.github.com/repos/numpy/numpy/issues/10776","id":473879190,"node_id":"MDEyOklzc3VlQ29tbWVudDQ3Mzg3OTE5MA==","user":{"login":"mattip","id":823911,"node_id":"MDQ6VXNlcjgyMzkxMQ==","avatar_url":"https://avatars0.githubusercontent.com/u/823911?v=4","gravatar_id":"","url":"https://api.github.com/users/mattip","html_url":"https://github.com/mattip","followers_url":"https://api.github.com/users/mattip/followers","following_url":"https://api.github.com/users/mattip/following{/other_user}","gists_url":"https://api.github.com/users/mattip/gists{/gist_id}","starred_url":"https://api.github.com/users/mattip/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mattip/subscriptions","organizations_url":"https://api.github.com/users/mattip/orgs","repos_url":"https://api.github.com/users/mattip/repos","events_url":"https://api.github.com/users/mattip/events{/privacy}","received_events_url":"https://api.github.com/users/mattip/received_events","type":"User","site_admin":false},"created_at":"2019-03-18T11:52:20Z","updated_at":"2019-03-18T11:52:20Z","author_association":"MEMBER","body":"I think #12428 would be a better choice, although it means we forego the ability to read some `npz` archives on python2."}}
{"actor":{"display_login":"mattip"}}