{"action":"created","issue":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/908","repository_url":"https://api.github.com/repos/tensorflow/tensorflow","labels_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/908/labels{/name}","comments_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/908/comments","events_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/908/events","html_url":"https://github.com/tensorflow/tensorflow/issues/908","id":129153143,"number":908,"title":"Visualizing CNNs with TensorBoard","user":{"login":"jeandut","id":11030901,"avatar_url":"https://avatars.githubusercontent.com/u/11030901?v=3","gravatar_id":"","url":"https://api.github.com/users/jeandut","html_url":"https://github.com/jeandut","followers_url":"https://api.github.com/users/jeandut/followers","following_url":"https://api.github.com/users/jeandut/following{/other_user}","gists_url":"https://api.github.com/users/jeandut/gists{/gist_id}","starred_url":"https://api.github.com/users/jeandut/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jeandut/subscriptions","organizations_url":"https://api.github.com/users/jeandut/orgs","repos_url":"https://api.github.com/users/jeandut/repos","events_url":"https://api.github.com/users/jeandut/events{/privacy}","received_events_url":"https://api.github.com/users/jeandut/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":14,"created_at":"2016-01-27T14:04:21Z","updated_at":"2016-03-27T11:29:29Z","closed_at":null,"body":"I am a huge fan of Tensorboard visualization however in my opinion it may lack good documentation when the user wants to implement non trivial visualization for example visualizing weights for a CNNs (or even features) (and also on how everything is stored and processed but that is another question).  \r\nI am runing a CNN on a set of color images the structure and the code of my cnn is almost entirely based on Deep MNIST tutorial/MNIST+tensorboard tutorial.\r\nI have several problems :\r\nI want to run tf.image_summary(W_conv1) every 100 steps/epochs of the training with W_conv1 being of shape (3,5,5,32) (first conv layer after an RGB image)\r\nHowever the desired shape is (32,5,5,3) so I reshape using `tf.reshape(W_conv1;shape=(32,5,5,3))`\r\nI am only using reshape because I could not find a numpy swapaxes equivalent in tf (and from the definition of reshape in numpy doc I am not sure wether or not it does exactly what I wanted but I agree it is my problem...).\r\nI call a `merge_all_summaries()` that I feed every 100 steps.\r\nI run 1000 epochs so I should get 320 images, instead I get 2 or 3 actually displayed !!!\r\nOn stackoverflow I found out that even if all the images are loaded into the memory (where?!) it does not display them all and that I should do something like initialize an empty tf.summary() and call `.MergefromString(image_summary)` but I am confused on exactly where in the code I should do that and at what time ?\r\nMy second issue is I also want to see the weights for the second conv layer which is of shape (32,5,5,64) so I would like to split it into (32x64) 5x5 images does that seem reasonnable ?\r\nHow would I go about displaying them ?\r\nSame for features obtained at different layers of the CNN ?\r\nI understand my questions are trivial but I think a lot of people would benefit (I would certainly) from an example of a clean and efficient code in tensorflow of a CNN on whatever image dataset WITH tensorboard visualization of the weights/features.\r\nThanks for the work TF is amazing !\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/tensorflow/tensorflow/issues/comments/202042775","html_url":"https://github.com/tensorflow/tensorflow/issues/908#issuecomment-202042775","issue_url":"https://api.github.com/repos/tensorflow/tensorflow/issues/908","id":202042775,"user":{"login":"jeandut","id":11030901,"avatar_url":"https://avatars.githubusercontent.com/u/11030901?v=3","gravatar_id":"","url":"https://api.github.com/users/jeandut","html_url":"https://github.com/jeandut","followers_url":"https://api.github.com/users/jeandut/followers","following_url":"https://api.github.com/users/jeandut/following{/other_user}","gists_url":"https://api.github.com/users/jeandut/gists{/gist_id}","starred_url":"https://api.github.com/users/jeandut/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jeandut/subscriptions","organizations_url":"https://api.github.com/users/jeandut/orgs","repos_url":"https://api.github.com/users/jeandut/repos","events_url":"https://api.github.com/users/jeandut/events{/privacy}","received_events_url":"https://api.github.com/users/jeandut/received_events","type":"User","site_admin":false},"created_at":"2016-03-27T11:29:29Z","updated_at":"2016-03-27T11:29:29Z","body":"Yeah thanks to you guys my plots are beginning to feel right ! @RobRomijnders this webpage is really nicely done ! I am hesitating to close this issue because it seems like the longer it lasts the more cool answers I am getting. However I can honestly say that my original question has been answered !"}}