{"action":"closed","issue":{"url":"https://api.github.com/repos/zubata88/mdgru/issues/10","repository_url":"https://api.github.com/repos/zubata88/mdgru","labels_url":"https://api.github.com/repos/zubata88/mdgru/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/zubata88/mdgru/issues/10/comments","events_url":"https://api.github.com/repos/zubata88/mdgru/issues/10/events","html_url":"https://github.com/zubata88/mdgru/issues/10","id":291519825,"number":10,"title":"Testing at multiple checkpoints","user":{"login":"neonroehre","id":35572536,"avatar_url":"https://avatars3.githubusercontent.com/u/35572536?v=4","gravatar_id":"","url":"https://api.github.com/users/neonroehre","html_url":"https://github.com/neonroehre","followers_url":"https://api.github.com/users/neonroehre/followers","following_url":"https://api.github.com/users/neonroehre/following{/other_user}","gists_url":"https://api.github.com/users/neonroehre/gists{/gist_id}","starred_url":"https://api.github.com/users/neonroehre/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/neonroehre/subscriptions","organizations_url":"https://api.github.com/users/neonroehre/orgs","repos_url":"https://api.github.com/users/neonroehre/repos","events_url":"https://api.github.com/users/neonroehre/events{/privacy}","received_events_url":"https://api.github.com/users/neonroehre/received_events","type":"User","site_admin":false},"labels":[{"id":783832795,"url":"https://api.github.com/repos/zubata88/mdgru/labels/enhancement","name":"enhancement","color":"84b6eb","default":true}],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-01-25T10:26:49Z","updated_at":"2018-05-07T11:38:39Z","closed_at":"2018-05-07T11:38:39Z","author_association":"COLLABORATOR","body":"Please implement a --testonly setup which is able to load multiple training ckpts.\r\nFor each ckpt it should test all relevant files in --locationtesting and save the results under the provided --optionname(s).\r\nFor --testonly at least one optionname should be provided. (--modelname=trainingname, --optionname==testingname)\r\n--optionname(s) should have the same length as --ckpt(s).\r\nif --optionname is singular, concatate the ckpt names to the optionname, provided the ckpt names are pairwise different.\r\n\r\nAdditionally, there should be a parameter whether to save all test results or only to store their scores in a .csv."}}
{"actor":{"display_login":"zubata88"}}