{"action":"created","issue":{"url":"https://api.github.com/repos/ESMValGroup/ESMValTool/issues/304","repository_url":"https://api.github.com/repos/ESMValGroup/ESMValTool","labels_url":"https://api.github.com/repos/ESMValGroup/ESMValTool/issues/304/labels{/name}","comments_url":"https://api.github.com/repos/ESMValGroup/ESMValTool/issues/304/comments","events_url":"https://api.github.com/repos/ESMValGroup/ESMValTool/issues/304/events","html_url":"https://github.com/ESMValGroup/ESMValTool/issues/304","id":313658650,"number":304,"title":"Delay concatenating after fixing metadata","user":{"login":"jvegasbsc","id":13482714,"avatar_url":"https://avatars2.githubusercontent.com/u/13482714?v=4","gravatar_id":"","url":"https://api.github.com/users/jvegasbsc","html_url":"https://github.com/jvegasbsc","followers_url":"https://api.github.com/users/jvegasbsc/followers","following_url":"https://api.github.com/users/jvegasbsc/following{/other_user}","gists_url":"https://api.github.com/users/jvegasbsc/gists{/gist_id}","starred_url":"https://api.github.com/users/jvegasbsc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jvegasbsc/subscriptions","organizations_url":"https://api.github.com/users/jvegasbsc/orgs","repos_url":"https://api.github.com/users/jvegasbsc/repos","events_url":"https://api.github.com/users/jvegasbsc/events{/privacy}","received_events_url":"https://api.github.com/users/jvegasbsc/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"jvegasbsc","id":13482714,"avatar_url":"https://avatars2.githubusercontent.com/u/13482714?v=4","gravatar_id":"","url":"https://api.github.com/users/jvegasbsc","html_url":"https://github.com/jvegasbsc","followers_url":"https://api.github.com/users/jvegasbsc/followers","following_url":"https://api.github.com/users/jvegasbsc/following{/other_user}","gists_url":"https://api.github.com/users/jvegasbsc/gists{/gist_id}","starred_url":"https://api.github.com/users/jvegasbsc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jvegasbsc/subscriptions","organizations_url":"https://api.github.com/users/jvegasbsc/orgs","repos_url":"https://api.github.com/users/jvegasbsc/repos","events_url":"https://api.github.com/users/jvegasbsc/events{/privacy}","received_events_url":"https://api.github.com/users/jvegasbsc/received_events","type":"User","site_admin":false},"assignees":[{"login":"jvegasbsc","id":13482714,"avatar_url":"https://avatars2.githubusercontent.com/u/13482714?v=4","gravatar_id":"","url":"https://api.github.com/users/jvegasbsc","html_url":"https://github.com/jvegasbsc","followers_url":"https://api.github.com/users/jvegasbsc/followers","following_url":"https://api.github.com/users/jvegasbsc/following{/other_user}","gists_url":"https://api.github.com/users/jvegasbsc/gists{/gist_id}","starred_url":"https://api.github.com/users/jvegasbsc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jvegasbsc/subscriptions","organizations_url":"https://api.github.com/users/jvegasbsc/orgs","repos_url":"https://api.github.com/users/jvegasbsc/repos","events_url":"https://api.github.com/users/jvegasbsc/events{/privacy}","received_events_url":"https://api.github.com/users/jvegasbsc/received_events","type":"User","site_admin":false}],"milestone":null,"comments":2,"created_at":"2018-04-12T10:03:23Z","updated_at":"2018-04-12T10:30:06Z","closed_at":null,"author_association":"CONTRIBUTOR","body":"I have some trouble with a dataset that has some random files with incorrect metadata. With the current backend workflow, I have to fix this at file level to be able to concatenate them into a single cube but this implies writing all the data to disk.\r\n\r\nMy idea is to add an extra merge/concatenate step after fixing metadata to allow us to fix these errors in the cube and avoid the extra writing.\r\n\r\nWhat do you think, @mattiarighi @valeriupredoi ?"},"comment":{"url":"https://api.github.com/repos/ESMValGroup/ESMValTool/issues/comments/380756515","html_url":"https://github.com/ESMValGroup/ESMValTool/issues/304#issuecomment-380756515","issue_url":"https://api.github.com/repos/ESMValGroup/ESMValTool/issues/304","id":380756515,"user":{"login":"jvegasbsc","id":13482714,"avatar_url":"https://avatars2.githubusercontent.com/u/13482714?v=4","gravatar_id":"","url":"https://api.github.com/users/jvegasbsc","html_url":"https://github.com/jvegasbsc","followers_url":"https://api.github.com/users/jvegasbsc/followers","following_url":"https://api.github.com/users/jvegasbsc/following{/other_user}","gists_url":"https://api.github.com/users/jvegasbsc/gists{/gist_id}","starred_url":"https://api.github.com/users/jvegasbsc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jvegasbsc/subscriptions","organizations_url":"https://api.github.com/users/jvegasbsc/orgs","repos_url":"https://api.github.com/users/jvegasbsc/repos","events_url":"https://api.github.com/users/jvegasbsc/events{/privacy}","received_events_url":"https://api.github.com/users/jvegasbsc/received_events","type":"User","site_admin":false},"created_at":"2018-04-12T10:30:06Z","updated_at":"2018-04-12T10:30:06Z","author_association":"CONTRIBUTOR","body":"The concatenate was done at the loading step, meaning that if there was any incompatibility in metadata we ended with a bunch of cubes that will make the backend crash in an unexpected way"}}
{"actor":{"display_login":"jvegasbsc"}}