{"push_id":2848860965,"size":1,"distinct_size":1,"ref":"refs/heads/master","head":"6c80531e159541cc081e5d5a8c33b4807e972ee6","before":"0354e4a19eb549f6a135934b46b3f5e3c2ccc3f2","commits":[{"sha":"6c80531e159541cc081e5d5a8c33b4807e972ee6","author":{"name":"Marko Grdinić","email":"5622e3ec1a18094ea0e746d23e3f804b2589765e@gmail.com"},"message":"It definitely works better now.\n\nSince it is not a bias addition how about I exchange that stupid thing with a hadamarad multiplication?\n\nEdit:\n\n```\nThe learning rate is 2 ** -5.500007\nStarting timing for: iteration 0\nThe time was 00:00:09.3934858 for: iteration 0\nTraining: 2.66135640214794\nThe learning rate is 2 ** -5.500007\nStarting timing for: iteration 1\nThe time was 00:00:09.2703308 for: iteration 1\nTraining: 2.13264193743613\nThe learning rate is 2 ** -5.500007\nStarting timing for: iteration 2\nThe time was 00:00:09.4793108 for: iteration 2\nTraining: 1.93510541395656\nThe learning rate is 2 ** -5.500007\nStarting timing for: iteration 3\nThe time was 00:00:09.3655695 for: iteration 3\nTraining: 1.82221499673356\nThe learning rate is 2 ** -5.500007\nStarting timing for: iteration 4\nThe time was 00:00:09.2944072 for: iteration 4\nTraining: 1.77633832914336\n```\n\nIt works. MI with Hebbian plasticity works just as well as the regular thing on the char RNN. I want to see how it performs on the full thing.\n\nBefore I decide to spent my time optimizing this thing I need to clean it up.\n\nTo be honest, I am not sure if there is even a point in expending effort on the full thing since I am just going to be using it for RL.\n\nSince the small char RNN works, the big one should do just as well.\n\nLet me clean it up though.","distinct":true,"url":"https://api.github.com/repos/mrakgr/The-Spiral-Language/commits/6c80531e159541cc081e5d5a8c33b4807e972ee6"}]}
{"actor":{"display_login":"mrakgr"}}