{"action":"created","issue":{"url":"https://api.github.com/repos/ganga-devs/ganga/issues/738","repository_url":"https://api.github.com/repos/ganga-devs/ganga","labels_url":"https://api.github.com/repos/ganga-devs/ganga/issues/738/labels{/name}","comments_url":"https://api.github.com/repos/ganga-devs/ganga/issues/738/comments","events_url":"https://api.github.com/repos/ganga-devs/ganga/issues/738/events","html_url":"https://github.com/ganga-devs/ganga/issues/738","id":171998890,"number":738,"title":"Fast accessURL on many Dirac files","user":{"login":"rmatev","id":6103896,"avatar_url":"https://avatars.githubusercontent.com/u/6103896?v=3","gravatar_id":"","url":"https://api.github.com/users/rmatev","html_url":"https://github.com/rmatev","followers_url":"https://api.github.com/users/rmatev/followers","following_url":"https://api.github.com/users/rmatev/following{/other_user}","gists_url":"https://api.github.com/users/rmatev/gists{/gist_id}","starred_url":"https://api.github.com/users/rmatev/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rmatev/subscriptions","organizations_url":"https://api.github.com/users/rmatev/orgs","repos_url":"https://api.github.com/users/rmatev/repos","events_url":"https://api.github.com/users/rmatev/events{/privacy}","received_events_url":"https://api.github.com/users/rmatev/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2016-08-18T20:56:51Z","updated_at":"2016-08-19T12:28:07Z","closed_at":null,"body":"`DiracFile.accessURL` is great, but way too slow (~8 s). I often have jobs with few hundred subjobs. If I call `.accessURL()` on the output file of each subjob, it will take O(hour) to get all the urls, which is unacceptable.\r\n\r\nMy solution to this was to make one Dirac call for many files:\r\n```python\r\nfrom GangaDirac.Lib.Utilities.DiracUtilities import execute\r\nopts = '--Protocol xroot,root'\r\ncmd = 'dirac-dms-lfn-accessURL {} {}'.format(','.join(lfns), opts)\r\noutput = execute(cmd, shell=True)\r\n```\r\n\r\nUnfortunately, this is broken in 6.1.22 (and 6.1.24), MWE:\r\n```python\r\n[22:42:41]\r\nGanga In [6]: from GangaDirac.Lib.Utilities.DiracUtilities import execute\r\n\r\n[22:42:46]\r\nGanga In [7]: execute('dirac-dms-lfn-accessURL /lhcb/user/r/rmatev/2016_08/136797/136797530/ntuples.root', shell=True)\r\nERROR    Error: insecure string pickle\r\nERROR    Unknown/Unexpected ERROR!!\r\n...\r\nValueError: insecure string pickle\r\n```\r\n\r\nI'd appreciate a lot any workarounds as well as a proper longer term solution."},"comment":{"url":"https://api.github.com/repos/ganga-devs/ganga/issues/comments/241005199","html_url":"https://github.com/ganga-devs/ganga/issues/738#issuecomment-241005199","issue_url":"https://api.github.com/repos/ganga-devs/ganga/issues/738","id":241005199,"user":{"login":"mesmith75","id":19779552,"avatar_url":"https://avatars.githubusercontent.com/u/19779552?v=3","gravatar_id":"","url":"https://api.github.com/users/mesmith75","html_url":"https://github.com/mesmith75","followers_url":"https://api.github.com/users/mesmith75/followers","following_url":"https://api.github.com/users/mesmith75/following{/other_user}","gists_url":"https://api.github.com/users/mesmith75/gists{/gist_id}","starred_url":"https://api.github.com/users/mesmith75/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mesmith75/subscriptions","organizations_url":"https://api.github.com/users/mesmith75/orgs","repos_url":"https://api.github.com/users/mesmith75/repos","events_url":"https://api.github.com/users/mesmith75/events{/privacy}","received_events_url":"https://api.github.com/users/mesmith75/received_events","type":"User","site_admin":false},"created_at":"2016-08-19T12:28:07Z","updated_at":"2016-08-19T12:28:07Z","body":"Yes that sounds good."}}
{"actor":{"display_login":"mesmith75"}}