{"push_id":2606840506,"size":1,"distinct_size":1,"ref":"refs/heads/songqing-stage","head":"fd234e317108b5d5649a707dd6b3d6da0b4222f8","before":"ac1e5a7d155aa38d10a0c4b036edf45467c8d876","commits":[{"sha":"fd234e317108b5d5649a707dd6b3d6da0b4222f8","author":{"name":"Alok Singh","email":"24f2c6b442855b4f407c4e6bcc07adca58385da2@users.noreply.github.com"},"message":"[rllib] Fix A3C PyTorch implementation (#2036)\n\n* Use F.softmax instead of a pointless network layer\r\n\r\nStateless functions should not be network layers.\r\n\r\n* Use correct pytorch functions\r\n\r\n* Rename argument name to out_size\r\n\r\nMatches in_size and makes more sense.\r\n\r\n* Fix shapes of tensors\r\n\r\nAdvantages and rewards both should be scalars, and therefore a list of them\r\nshould be 1D.\r\n\r\n* Fmt\r\n\r\n* replace deprecated function\r\n\r\n* rm unnecessary Variable wrapper\r\n\r\n* rm all use of torch Variables\r\n\r\nTorch does this for us now.\r\n\r\n* Ensure that values are flat list\r\n\r\n* Fix shape error in conv nets\r\n\r\n* fmt\r\n\r\n* Fix shape errors\r\n\r\nReshaping the action before stepping in the env fixes a few errors.\r\n\r\n* Add TODO\r\n\r\n* Use correct filter size\r\n\r\nWorks when `self.config['model']['channel_major'] = True`.\r\n\r\n* Add missing channel major\r\n\r\n* Revert reshape of action\r\n\r\nThis should be handled by the agent or at least in a cleaner way that doesn't\r\nbreak existing envs.\r\n\r\n* Squeeze action\r\n\r\n* Squeeze actions along first dimension\r\n\r\nThis should deal with some cases such as cartpole where actions are scalars\r\nwhile leaving alone cases where actions are arrays (some robotics tasks).\r\n\r\n* try adding pytorch tests\r\n\r\n* typo\r\n\r\n* fixup docker messages\r\n\r\n* Fix A3C for some envs\r\n\r\nPendulum doesn't work since it's an edge case (expects singleton arrays, which\r\n`.squeeze()` collapses to scalars).\r\n\r\n* fmt\r\n\r\n* nit flake\r\n\r\n* small lint","distinct":true,"url":"https://api.github.com/repos/ant-tech-alliance/ray/commits/fd234e317108b5d5649a707dd6b3d6da0b4222f8"}]}
{"actor":{"display_login":"songqing"}}