{"action":"created","issue":{"url":"https://api.github.com/repos/fchollet/keras/issues/1753","repository_url":"https://api.github.com/repos/fchollet/keras","labels_url":"https://api.github.com/repos/fchollet/keras/issues/1753/labels{/name}","comments_url":"https://api.github.com/repos/fchollet/keras/issues/1753/comments","events_url":"https://api.github.com/repos/fchollet/keras/issues/1753/events","html_url":"https://github.com/fchollet/keras/issues/1753","id":134565959,"number":1753,"title":"Test data being used for validation data?","user":{"login":"KeironO","id":4386515,"avatar_url":"https://avatars.githubusercontent.com/u/4386515?v=3","gravatar_id":"","url":"https://api.github.com/users/KeironO","html_url":"https://github.com/KeironO","followers_url":"https://api.github.com/users/KeironO/followers","following_url":"https://api.github.com/users/KeironO/following{/other_user}","gists_url":"https://api.github.com/users/KeironO/gists{/gist_id}","starred_url":"https://api.github.com/users/KeironO/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/KeironO/subscriptions","organizations_url":"https://api.github.com/users/KeironO/orgs","repos_url":"https://api.github.com/users/KeironO/repos","events_url":"https://api.github.com/users/KeironO/events{/privacy}","received_events_url":"https://api.github.com/users/KeironO/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":19,"created_at":"2016-02-18T12:18:57Z","updated_at":"2016-11-03T05:24:24Z","closed_at":"2016-02-18T17:08:17Z","body":"Hey there,\n\nIn many of your examples you seem to be using the test data as validation data, wouldn't this create an overfitted model that is unable to generalise?\n\nExample: https://github.com/fchollet/keras/blob/master/examples/cifar10_cnn.py#L80\n"},"comment":{"url":"https://api.github.com/repos/fchollet/keras/issues/comments/258066612","html_url":"https://github.com/fchollet/keras/issues/1753#issuecomment-258066612","issue_url":"https://api.github.com/repos/fchollet/keras/issues/1753","id":258066612,"user":{"login":"lbugnon","id":11859134,"avatar_url":"https://avatars.githubusercontent.com/u/11859134?v=3","gravatar_id":"","url":"https://api.github.com/users/lbugnon","html_url":"https://github.com/lbugnon","followers_url":"https://api.github.com/users/lbugnon/followers","following_url":"https://api.github.com/users/lbugnon/following{/other_user}","gists_url":"https://api.github.com/users/lbugnon/gists{/gist_id}","starred_url":"https://api.github.com/users/lbugnon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lbugnon/subscriptions","organizations_url":"https://api.github.com/users/lbugnon/orgs","repos_url":"https://api.github.com/users/lbugnon/repos","events_url":"https://api.github.com/users/lbugnon/events{/privacy}","received_events_url":"https://api.github.com/users/lbugnon/received_events","type":"User","site_admin":false},"created_at":"2016-11-03T05:24:24Z","updated_at":"2016-11-03T05:24:24Z","body":"I think the model.fit method (and documentation) is misleading. It's not that obvious that the \"validation_data=(X_test, Y_test)\" is used only for documenting progress and none optimization is made using that data. In fact, if you are going to feed a \"training\" function like fit (i know, its not the training function, but similar) with a train and test set, you should state CLEARLY why are you doing that, and what use is given to this test(or validation) data."}}
{"actor":{"display_login":"lbugnon"}}