{"action":"created","issue":{"url":"https://api.github.com/repos/BD2KGenomics/toil/issues/697","repository_url":"https://api.github.com/repos/BD2KGenomics/toil","labels_url":"https://api.github.com/repos/BD2KGenomics/toil/issues/697/labels{/name}","comments_url":"https://api.github.com/repos/BD2KGenomics/toil/issues/697/comments","events_url":"https://api.github.com/repos/BD2KGenomics/toil/issues/697/events","html_url":"https://github.com/BD2KGenomics/toil/issues/697","id":135640417,"number":697,"title":"Better, more persistent handling of logs","user":{"login":"fnothaft","id":3752466,"avatar_url":"https://avatars.githubusercontent.com/u/3752466?v=3","gravatar_id":"","url":"https://api.github.com/users/fnothaft","html_url":"https://github.com/fnothaft","followers_url":"https://api.github.com/users/fnothaft/followers","following_url":"https://api.github.com/users/fnothaft/following{/other_user}","gists_url":"https://api.github.com/users/fnothaft/gists{/gist_id}","starred_url":"https://api.github.com/users/fnothaft/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fnothaft/subscriptions","organizations_url":"https://api.github.com/users/fnothaft/orgs","repos_url":"https://api.github.com/users/fnothaft/repos","events_url":"https://api.github.com/users/fnothaft/events{/privacy}","received_events_url":"https://api.github.com/users/fnothaft/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/BD2KGenomics/toil/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2016-02-23T05:35:17Z","updated_at":"2016-03-07T06:04:51Z","closed_at":null,"body":"As discussed on #687, there is good reason to treat logfiles as akin to data generated by an analysis pipeline. Unfortunately, right now, the only options are to steal the logfiles from the clutches of the temporary job folders on the toil workers, or to grab truncated files that are stashed away in the jobstore. We should solve this scourge and help those betrayed by the log files that have dashed off into the sunset."},"comment":{"url":"https://api.github.com/repos/BD2KGenomics/toil/issues/comments/193118409","html_url":"https://github.com/BD2KGenomics/toil/issues/697#issuecomment-193118409","issue_url":"https://api.github.com/repos/BD2KGenomics/toil/issues/697","id":193118409,"user":{"login":"fnothaft","id":3752466,"avatar_url":"https://avatars.githubusercontent.com/u/3752466?v=3","gravatar_id":"","url":"https://api.github.com/users/fnothaft","html_url":"https://github.com/fnothaft","followers_url":"https://api.github.com/users/fnothaft/followers","following_url":"https://api.github.com/users/fnothaft/following{/other_user}","gists_url":"https://api.github.com/users/fnothaft/gists{/gist_id}","starred_url":"https://api.github.com/users/fnothaft/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fnothaft/subscriptions","organizations_url":"https://api.github.com/users/fnothaft/orgs","repos_url":"https://api.github.com/users/fnothaft/repos","events_url":"https://api.github.com/users/fnothaft/events{/privacy}","received_events_url":"https://api.github.com/users/fnothaft/received_events","type":"User","site_admin":false},"created_at":"2016-03-07T06:04:51Z","updated_at":"2016-03-07T06:04:51Z","body":"Just wanted to add a point to this. Being able to disable workdir cleaning is great, but oftentimes, I really want the logs, but I don't want the workdir, because the logs are orders of magnitude smaller than the workdirs, and my workdirs don't give me any additional ability to debug beyond my raw pipeline inputs."}}