{"action":"created","issue":{"url":"https://api.github.com/repos/nishnik/sherlocked/issues/3","repository_url":"https://api.github.com/repos/nishnik/sherlocked","labels_url":"https://api.github.com/repos/nishnik/sherlocked/issues/3/labels{/name}","comments_url":"https://api.github.com/repos/nishnik/sherlocked/issues/3/comments","events_url":"https://api.github.com/repos/nishnik/sherlocked/issues/3/events","html_url":"https://github.com/nishnik/sherlocked/issues/3","id":278401731,"number":3,"title":"Use two activation functions in same layer","user":{"login":"nishnik","id":9252491,"avatar_url":"https://avatars2.githubusercontent.com/u/9252491?v=4","gravatar_id":"","url":"https://api.github.com/users/nishnik","html_url":"https://github.com/nishnik","followers_url":"https://api.github.com/users/nishnik/followers","following_url":"https://api.github.com/users/nishnik/following{/other_user}","gists_url":"https://api.github.com/users/nishnik/gists{/gist_id}","starred_url":"https://api.github.com/users/nishnik/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nishnik/subscriptions","organizations_url":"https://api.github.com/users/nishnik/orgs","repos_url":"https://api.github.com/users/nishnik/repos","events_url":"https://api.github.com/users/nishnik/events{/privacy}","received_events_url":"https://api.github.com/users/nishnik/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-12-01T09:10:38Z","updated_at":"2018-03-23T19:39:35Z","closed_at":null,"author_association":"OWNER","body":"You will have to change the `MLPNetModified` in [inspect_activations](https://github.com/nishnik/sherlocked/blob/master/inspect_activations/main.py) so that one layer uses two activation functions.\r\n\r\nSo the networks should be:\r\n``` \r\nx - fc1 - fc1_sigmoid_half - fc2 - fc2_sigmoid_half - fc3 - fc3_sigmoid_half - softmax\r\n        - fc1_relu_half          - fc2_relu_half           - fc3_relu_half\r\n```\r\nPR should be made as a new folder in inspect_activations folder. With the output accuracies as a table in a Mark down file. Provided with the code used"},"comment":{"url":"https://api.github.com/repos/nishnik/sherlocked/issues/comments/375777147","html_url":"https://github.com/nishnik/sherlocked/issues/3#issuecomment-375777147","issue_url":"https://api.github.com/repos/nishnik/sherlocked/issues/3","id":375777147,"user":{"login":"RoyiAvital","id":7347975,"avatar_url":"https://avatars1.githubusercontent.com/u/7347975?v=4","gravatar_id":"","url":"https://api.github.com/users/RoyiAvital","html_url":"https://github.com/RoyiAvital","followers_url":"https://api.github.com/users/RoyiAvital/followers","following_url":"https://api.github.com/users/RoyiAvital/following{/other_user}","gists_url":"https://api.github.com/users/RoyiAvital/gists{/gist_id}","starred_url":"https://api.github.com/users/RoyiAvital/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/RoyiAvital/subscriptions","organizations_url":"https://api.github.com/users/RoyiAvital/orgs","repos_url":"https://api.github.com/users/RoyiAvital/repos","events_url":"https://api.github.com/users/RoyiAvital/events{/privacy}","received_events_url":"https://api.github.com/users/RoyiAvital/received_events","type":"User","site_admin":false},"created_at":"2018-03-23T19:39:35Z","updated_at":"2018-03-23T19:39:35Z","author_association":"NONE","body":"I don't understand what you meant in your [Is ReLU after Sigmoid bad?](https://towardsdatascience.com/is-relu-after-sigmoid-bad-661fda45f7a2) post by saying:\r\n\r\n> Except for the input layer we use a non-linearity on each layer’s output.\r\n\r\nI suppose you have `inputLayer(784) -> hiddenLayer001 (500) --> activationLayer001 -> hiddenLayer002 (256) --> activationLayer002 -> outputLayer(10) --> activationLayer003`.\r\n\r\nIs that right?\r\n "}}
{"actor":{"display_login":"RoyiAvital"}}