{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/models/issues/3387","repository_url":"https://api.github.com/repos/tensorflow/models","labels_url":"https://api.github.com/repos/tensorflow/models/issues/3387/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/models/issues/3387/comments","events_url":"https://api.github.com/repos/tensorflow/models/issues/3387/events","html_url":"https://github.com/tensorflow/models/issues/3387","id":297300173,"number":3387,"title":"DELF: Training procedure","user":{"login":"bkj","id":6086781,"avatar_url":"https://avatars0.githubusercontent.com/u/6086781?v=4","gravatar_id":"","url":"https://api.github.com/users/bkj","html_url":"https://github.com/bkj","followers_url":"https://api.github.com/users/bkj/followers","following_url":"https://api.github.com/users/bkj/following{/other_user}","gists_url":"https://api.github.com/users/bkj/gists{/gist_id}","starred_url":"https://api.github.com/users/bkj/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bkj/subscriptions","organizations_url":"https://api.github.com/users/bkj/orgs","repos_url":"https://api.github.com/users/bkj/repos","events_url":"https://api.github.com/users/bkj/events{/privacy}","received_events_url":"https://api.github.com/users/bkj/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2018-02-15T01:07:02Z","updated_at":"2018-02-21T03:48:56Z","closed_at":null,"author_association":"NONE","body":"Are the DELF authors able to give a little more detail about how they train their model?  Any insight into things like\r\n\r\n    - cross-entropy loss and/or accuracy curves during fine-tuning training and/or attention training\r\n    - number of epochs of training; number of GPUs; wall clock time\r\n    - learning rates; how layers are frozen/unfrozen\r\n    - how/whether hyperparameters were tuned on a validation set\r\n\r\nwould be super helpful.  Any specific pointers to other projects (maybe in this repo?) that used a roughly similar procedure would be helpful as well.\r\n\r\nEDIT: Also, can you verify that both the fine-tuning and attention models were trained on [this dataset](http://sites.skoltech.ru/compvision/projects/neuralcodes/), rather than the Google-Landmarks dataset introduced in your paper.\r\n\r\nThanks\r\nBen\r\n\r\ncc @andrefaraujo "},"comment":{"url":"https://api.github.com/repos/tensorflow/models/issues/comments/367205039","html_url":"https://github.com/tensorflow/models/issues/3387#issuecomment-367205039","issue_url":"https://api.github.com/repos/tensorflow/models/issues/3387","id":367205039,"user":{"login":"bkj","id":6086781,"avatar_url":"https://avatars0.githubusercontent.com/u/6086781?v=4","gravatar_id":"","url":"https://api.github.com/users/bkj","html_url":"https://github.com/bkj","followers_url":"https://api.github.com/users/bkj/followers","following_url":"https://api.github.com/users/bkj/following{/other_user}","gists_url":"https://api.github.com/users/bkj/gists{/gist_id}","starred_url":"https://api.github.com/users/bkj/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bkj/subscriptions","organizations_url":"https://api.github.com/users/bkj/orgs","repos_url":"https://api.github.com/users/bkj/repos","events_url":"https://api.github.com/users/bkj/events{/privacy}","received_events_url":"https://api.github.com/users/bkj/received_events","type":"User","site_admin":false},"created_at":"2018-02-21T03:48:56Z","updated_at":"2018-02-21T03:48:56Z","author_association":"NONE","body":"Ah ok -- thanks.  Do you know the names of the layers that I'd need to grab to get a) the features and b) the attention weights?  The output of `graph.get_tensor_by_name('features:0')` look like they've already gone through non-maximum suppression and PCA -- presumably if I want to train the softmax classifier, I should be using the original dimension features?\r\n\r\n~ Ben"}}
{"actor":{"display_login":"bkj"}}