{"action":"created","issue":{"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1336","repository_url":"https://api.github.com/repos/cooperative-computing-lab/cctools","labels_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1336/labels{/name}","comments_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1336/comments","events_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1336/events","html_url":"https://github.com/cooperative-computing-lab/cctools/issues/1336","id":155146702,"number":1336,"title":"condor transfer output files outside wq control","user":{"login":"btovar","id":3081826,"avatar_url":"https://avatars.githubusercontent.com/u/3081826?v=3","gravatar_id":"","url":"https://api.github.com/users/btovar","html_url":"https://github.com/btovar","followers_url":"https://api.github.com/users/btovar/followers","following_url":"https://api.github.com/users/btovar/following{/other_user}","gists_url":"https://api.github.com/users/btovar/gists{/gist_id}","starred_url":"https://api.github.com/users/btovar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/btovar/subscriptions","organizations_url":"https://api.github.com/users/btovar/orgs","repos_url":"https://api.github.com/users/btovar/repos","events_url":"https://api.github.com/users/btovar/events{/privacy}","received_events_url":"https://api.github.com/users/btovar/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/milestones/27","html_url":"https://github.com/cooperative-computing-lab/cctools/milestones/5.5","labels_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/milestones/27/labels","id":1572666,"number":27,"title":"5.5","description":"","creator":{"login":"btovar","id":3081826,"avatar_url":"https://avatars.githubusercontent.com/u/3081826?v=3","gravatar_id":"","url":"https://api.github.com/users/btovar","html_url":"https://github.com/btovar","followers_url":"https://api.github.com/users/btovar/followers","following_url":"https://api.github.com/users/btovar/following{/other_user}","gists_url":"https://api.github.com/users/btovar/gists{/gist_id}","starred_url":"https://api.github.com/users/btovar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/btovar/subscriptions","organizations_url":"https://api.github.com/users/btovar/orgs","repos_url":"https://api.github.com/users/btovar/repos","events_url":"https://api.github.com/users/btovar/events{/privacy}","received_events_url":"https://api.github.com/users/btovar/received_events","type":"User","site_admin":false},"open_issues":9,"closed_issues":58,"state":"open","created_at":"2016-02-09T14:30:03Z","updated_at":"2016-05-16T23:42:05Z","due_on":null,"closed_at":null},"comments":3,"created_at":"2016-05-16T23:42:05Z","updated_at":"2016-05-17T00:46:36Z","closed_at":null,"body":"As observed by @annawoodard.\r\n\r\nA process is writing outside the task directory, at _CONDOR_SCRATCH_DIR. When the worker disconnects, condor transfer back that file. Some of those files are above 150GB, which were filling /tmp at the submission site.\r\n\r\nTwo solutions:\r\n\r\na) Specify transfer_output_files =\"\"  ,  which disables the automatic transfer.  Before condor 7.9 it creates a file named \"\" at the submission site (as discussed here: \r\nhttps://www-auth.cs.wisc.edu/lists/htcondor-users/2013-January/msg00045.shtml ).\r\n\r\nb) The worker removes any file at _CONDOR_SCRATCH_DIR as part of its cleanup.\r\n\r\n@dthain?\r\n"},"comment":{"url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/comments/219590294","html_url":"https://github.com/cooperative-computing-lab/cctools/issues/1336#issuecomment-219590294","issue_url":"https://api.github.com/repos/cooperative-computing-lab/cctools/issues/1336","id":219590294,"user":{"login":"dthain","id":2752914,"avatar_url":"https://avatars.githubusercontent.com/u/2752914?v=3","gravatar_id":"","url":"https://api.github.com/users/dthain","html_url":"https://github.com/dthain","followers_url":"https://api.github.com/users/dthain/followers","following_url":"https://api.github.com/users/dthain/following{/other_user}","gists_url":"https://api.github.com/users/dthain/gists{/gist_id}","starred_url":"https://api.github.com/users/dthain/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dthain/subscriptions","organizations_url":"https://api.github.com/users/dthain/orgs","repos_url":"https://api.github.com/users/dthain/repos","events_url":"https://api.github.com/users/dthain/events{/privacy}","received_events_url":"https://api.github.com/users/dthain/received_events","type":"User","site_admin":false},"created_at":"2016-05-17T00:46:36Z","updated_at":"2016-05-17T00:46:36Z","body":"To clarify, is the problem that that *worker* is creating output in `$_CONDOR_SCRATCH_DIR` (e.g. cache dir and such) or that the *tasks* are doing so?"}}