{"action":"created","issue":{"url":"https://api.github.com/repos/UFAL-DSG/tgen/issues/39","repository_url":"https://api.github.com/repos/UFAL-DSG/tgen","labels_url":"https://api.github.com/repos/UFAL-DSG/tgen/issues/39/labels{/name}","comments_url":"https://api.github.com/repos/UFAL-DSG/tgen/issues/39/comments","events_url":"https://api.github.com/repos/UFAL-DSG/tgen/issues/39/events","html_url":"https://github.com/UFAL-DSG/tgen/issues/39","id":372991228,"node_id":"MDU6SXNzdWUzNzI5OTEyMjg=","number":39,"title":"checkpoint at every epoch","user":{"login":"giobin","id":3843501,"node_id":"MDQ6VXNlcjM4NDM1MDE=","avatar_url":"https://avatars2.githubusercontent.com/u/3843501?v=4","gravatar_id":"","url":"https://api.github.com/users/giobin","html_url":"https://github.com/giobin","followers_url":"https://api.github.com/users/giobin/followers","following_url":"https://api.github.com/users/giobin/following{/other_user}","gists_url":"https://api.github.com/users/giobin/gists{/gist_id}","starred_url":"https://api.github.com/users/giobin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/giobin/subscriptions","organizations_url":"https://api.github.com/users/giobin/orgs","repos_url":"https://api.github.com/users/giobin/repos","events_url":"https://api.github.com/users/giobin/events{/privacy}","received_events_url":"https://api.github.com/users/giobin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2018-10-23T13:09:13Z","updated_at":"2018-11-22T14:05:42Z","closed_at":null,"author_association":"NONE","body":"Hello,\r\nI'm working on the E2E Challenge dataset and I'm wondering if there is a way to create a checkpoint of the system at every epoch during training. This way it will be possible to calculate the metrics after every epoch.\r\n\r\nThanks"},"comment":{"url":"https://api.github.com/repos/UFAL-DSG/tgen/issues/comments/441040581","html_url":"https://github.com/UFAL-DSG/tgen/issues/39#issuecomment-441040581","issue_url":"https://api.github.com/repos/UFAL-DSG/tgen/issues/39","id":441040581,"node_id":"MDEyOklzc3VlQ29tbWVudDQ0MTA0MDU4MQ==","user":{"login":"tuetschek","id":2931158,"node_id":"MDQ6VXNlcjI5MzExNTg=","avatar_url":"https://avatars1.githubusercontent.com/u/2931158?v=4","gravatar_id":"","url":"https://api.github.com/users/tuetschek","html_url":"https://github.com/tuetschek","followers_url":"https://api.github.com/users/tuetschek/followers","following_url":"https://api.github.com/users/tuetschek/following{/other_user}","gists_url":"https://api.github.com/users/tuetschek/gists{/gist_id}","starred_url":"https://api.github.com/users/tuetschek/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tuetschek/subscriptions","organizations_url":"https://api.github.com/users/tuetschek/orgs","repos_url":"https://api.github.com/users/tuetschek/repos","events_url":"https://api.github.com/users/tuetschek/events{/privacy}","received_events_url":"https://api.github.com/users/tuetschek/received_events","type":"User","site_admin":false},"created_at":"2018-11-22T14:05:42Z","updated_at":"2018-11-22T14:05:42Z","author_association":"MEMBER","body":"Hi @giobin , \r\n\r\nthanks for your interest in TGen and E2E data and sorry for the extremely late answer. \r\n\r\nThe system will currently create a checkpoint after every epoch if you set `validation_freq` in the config file to `1`, but only if the performance on the validation data is improved.\r\n\r\nTo change this behavior, you may want to change the code [here](https://github.com/UFAL-DSG/tgen/blob/master/tgen/seq2seq.py#L905), removing the `if` condition should do :-). You also might want to adapt the [`_save_checkpoint`](https://github.com/UFAL-DSG/tgen/blob/master/tgen/seq2seq.py#L992) method so that it uses a different file name each time.\r\n\r\nHope this helps. Let me know if you need more information."}}
{"actor":{"display_login":"tuetschek"}}