{"action":"created","issue":{"url":"https://api.github.com/repos/saltstack/salt/issues/25672","repository_url":"https://api.github.com/repos/saltstack/salt","labels_url":"https://api.github.com/repos/saltstack/salt/issues/25672/labels{/name}","comments_url":"https://api.github.com/repos/saltstack/salt/issues/25672/comments","events_url":"https://api.github.com/repos/saltstack/salt/issues/25672/events","html_url":"https://github.com/saltstack/salt/issues/25672","id":96891245,"number":25672,"title":"Large file transfers through gitfs are very slow","user":{"login":"bradthurber","id":3045456,"avatar_url":"https://avatars.githubusercontent.com/u/3045456?v=3","gravatar_id":"","url":"https://api.github.com/users/bradthurber","html_url":"https://github.com/bradthurber","followers_url":"https://api.github.com/users/bradthurber/followers","following_url":"https://api.github.com/users/bradthurber/following{/other_user}","gists_url":"https://api.github.com/users/bradthurber/gists{/gist_id}","starred_url":"https://api.github.com/users/bradthurber/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bradthurber/subscriptions","organizations_url":"https://api.github.com/users/bradthurber/orgs","repos_url":"https://api.github.com/users/bradthurber/repos","events_url":"https://api.github.com/users/bradthurber/events{/privacy}","received_events_url":"https://api.github.com/users/bradthurber/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/saltstack/salt/labels/Bug","name":"Bug","color":"e11d21"},{"url":"https://api.github.com/repos/saltstack/salt/labels/File%20Servers","name":"File Servers","color":"006b75"},{"url":"https://api.github.com/repos/saltstack/salt/labels/High%20Severity","name":"High Severity","color":"ff9143"},{"url":"https://api.github.com/repos/saltstack/salt/labels/P2","name":"P2","color":"155fb5"},{"url":"https://api.github.com/repos/saltstack/salt/labels/Platform","name":"Platform","color":"fef2c0"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":{"url":"https://api.github.com/repos/saltstack/salt/milestones/13","html_url":"https://github.com/saltstack/salt/milestones/Approved","labels_url":"https://api.github.com/repos/saltstack/salt/milestones/13/labels","id":9265,"number":13,"title":"Approved","description":"All issues that are ready to be worked on, both bugs and features.","creator":{"login":"thatch45","id":507599,"avatar_url":"https://avatars.githubusercontent.com/u/507599?v=3","gravatar_id":"","url":"https://api.github.com/users/thatch45","html_url":"https://github.com/thatch45","followers_url":"https://api.github.com/users/thatch45/followers","following_url":"https://api.github.com/users/thatch45/following{/other_user}","gists_url":"https://api.github.com/users/thatch45/gists{/gist_id}","starred_url":"https://api.github.com/users/thatch45/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thatch45/subscriptions","organizations_url":"https://api.github.com/users/thatch45/orgs","repos_url":"https://api.github.com/users/thatch45/repos","events_url":"https://api.github.com/users/thatch45/events{/privacy}","received_events_url":"https://api.github.com/users/thatch45/received_events","type":"User","site_admin":false},"open_issues":3161,"closed_issues":3956,"state":"open","created_at":"2011-05-14T04:00:56Z","updated_at":"2016-08-30T02:01:48Z","due_on":null,"closed_at":null},"comments":9,"created_at":"2015-07-23T19:45:23Z","updated_at":"2016-08-30T08:53:39Z","closed_at":null,"body":"Note: This is a follow-on to #25455\r\n\r\nRepro steps:\r\n1) Setup gitfs using pygit2\r\n2) Add this repo that contains a 100MB file to the gitfs config: \r\nhttps://github.com/edubart/testrepo\r\n3) copy file out of formula to minion:\r\nsalt 'minion-name' cp.get_url salt://largefile /tmp/largefile\r\n4) watch the target directory. You should notice the file size increasing about 1MB/minute\r\n\r\nI'm probably getting too fancy with expecting large files to smoothly make the transition through gitfs in this way - and I'm aware of the large file/binary file limitations of git; however, adding setup code (large RPMs to a formula could be a nice way of encapsulating what certain formulas need to accomplish (I'm looking at you oracle sql client RPM!).\r\n\r\nPerhaps this is an issue with pygit2/libgit rather than salt - but the large file issue was supposed to be fixed in a much older libgit. Ref: https://github.com/libgit2/libgit2/issues/1081\r\n"},"comment":{"url":"https://api.github.com/repos/saltstack/salt/issues/comments/243375386","html_url":"https://github.com/saltstack/salt/issues/25672#issuecomment-243375386","issue_url":"https://api.github.com/repos/saltstack/salt/issues/25672","id":243375386,"user":{"login":"PKiman","id":15966904,"avatar_url":"https://avatars.githubusercontent.com/u/15966904?v=3","gravatar_id":"","url":"https://api.github.com/users/PKiman","html_url":"https://github.com/PKiman","followers_url":"https://api.github.com/users/PKiman/followers","following_url":"https://api.github.com/users/PKiman/following{/other_user}","gists_url":"https://api.github.com/users/PKiman/gists{/gist_id}","starred_url":"https://api.github.com/users/PKiman/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/PKiman/subscriptions","organizations_url":"https://api.github.com/users/PKiman/orgs","repos_url":"https://api.github.com/users/PKiman/repos","events_url":"https://api.github.com/users/PKiman/events{/privacy}","received_events_url":"https://api.github.com/users/PKiman/received_events","type":"User","site_admin":false},"created_at":"2016-08-30T08:53:39Z","updated_at":"2016-08-30T08:53:39Z","body":"I am running into the same issue and was hoping that git-lfs (git large file support) would help, but git-lfs isn't supported apparently yet by pygit2 nor GitPython. \r\nhttps://git-lfs.github.com/ \r\ngit-lfs is supported by some repo providers yet like github and recently bitbucket.\r\n\r\n"}}
{"actor":{"display_login":"PKiman"}}