{"push_id":2374162526,"size":4,"distinct_size":4,"ref":"refs/heads/master","head":"ece9c4a9e98e1ca97771c8ad15a088a52f63c5d8","before":"a49348075e7ce15e6b1c4e751d0059fdbfa34c55","commits":[{"sha":"ebc67e016ef9c727dbad781b01abc4df8396e0e5","author":{"name":"Dan Murphy","email":"ee185fae65e9ebf42655211c38255d4a17d35d76@gmail.com"},"message":"Fix comment","distinct":true,"url":"https://api.github.com/repos/Murphydbuffalo/smile-o-meter/commits/ebc67e016ef9c727dbad781b01abc4df8396e0e5"},{"sha":"420961fd9c2c257bfac3bf959672a74c18dc10f7","author":{"name":"Dan Murphy","email":"ee185fae65e9ebf42655211c38255d4a17d35d76@gmail.com"},"message":"Better explanation of why we only apply a gradient check to the last two layers","distinct":true,"url":"https://api.github.com/repos/Murphydbuffalo/smile-o-meter/commits/420961fd9c2c257bfac3bf959672a74c18dc10f7"},{"sha":"0dd20292c43dd888fbeffb8c0525b0f5d541b594","author":{"name":"Dan Murphy","email":"ee185fae65e9ebf42655211c38255d4a17d35d76@gmail.com"},"message":"Remove unnecessary thresholding of values.\n\nOriginally I added code to ensure that values in forward prop and the\ncost function didn't overflow or underflow, but this turned out to be\nunnecessary. The reaason this numerical instability was occuring was\nbecause I wasn't computing the analytic gradients correctly during\nbackprop. This resulted in gradients that were far too large, which in\nturn caused we network's weights to become too large, which finally\nresulted in super high values in forward prop and the cost function as\nmore and more iterations were performed.","distinct":true,"url":"https://api.github.com/repos/Murphydbuffalo/smile-o-meter/commits/0dd20292c43dd888fbeffb8c0525b0f5d541b594"},{"sha":"ece9c4a9e98e1ca97771c8ad15a088a52f63c5d8","author":{"name":"Dan Murphy","email":"ee185fae65e9ebf42655211c38255d4a17d35d76@gmail.com"},"message":"Fix computation of hidden layer gradients.\n\nAnd generally simplify the backprop code.","distinct":true,"url":"https://api.github.com/repos/Murphydbuffalo/smile-o-meter/commits/ece9c4a9e98e1ca97771c8ad15a088a52f63c5d8"}]}
{"actor":{"display_login":"Murphydbuffalo"}}