{"action":"created","issue":{"url":"https://api.github.com/repos/apache/incubator-systemml/issues/160","repository_url":"https://api.github.com/repos/apache/incubator-systemml","labels_url":"https://api.github.com/repos/apache/incubator-systemml/issues/160/labels{/name}","comments_url":"https://api.github.com/repos/apache/incubator-systemml/issues/160/comments","events_url":"https://api.github.com/repos/apache/incubator-systemml/issues/160/events","html_url":"https://github.com/apache/incubator-systemml/pull/160","id":155126360,"number":160,"title":"[SYSTEMML-618] Deep Learning DML Library","user":{"login":"dusenberrymw","id":5431337,"avatar_url":"https://avatars.githubusercontent.com/u/5431337?v=3","gravatar_id":"","url":"https://api.github.com/users/dusenberrymw","html_url":"https://github.com/dusenberrymw","followers_url":"https://api.github.com/users/dusenberrymw/followers","following_url":"https://api.github.com/users/dusenberrymw/following{/other_user}","gists_url":"https://api.github.com/users/dusenberrymw/gists{/gist_id}","starred_url":"https://api.github.com/users/dusenberrymw/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dusenberrymw/subscriptions","organizations_url":"https://api.github.com/users/dusenberrymw/orgs","repos_url":"https://api.github.com/users/dusenberrymw/repos","events_url":"https://api.github.com/users/dusenberrymw/events{/privacy}","received_events_url":"https://api.github.com/users/dusenberrymw/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":12,"created_at":"2016-05-16T21:28:40Z","updated_at":"2016-05-18T18:52:48Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/incubator-systemml/pulls/160","html_url":"https://github.com/apache/incubator-systemml/pull/160","diff_url":"https://github.com/apache/incubator-systemml/pull/160.diff","patch_url":"https://github.com/apache/incubator-systemml/pull/160.patch"},"body":"This introduces a new deep learning DML library, **SystemML-NN**.  SystemML-NN is a layers-based library written in pure DML that contains layers with a simple forward/backward API for affine, spatial convolution, max-pooling, non-linearities (relu, sigmoid, softmax, etc.), dropout, loss functions, other layers, optimizers, and gradient checks.\r\n\r\n**SystemML-NN**:\r\n* Layers:\r\n  * Core:\r\n    * Affine\r\n    * Spatial Convolution\r\n    * Max Pooling\r\n  * Nonlinearities:\r\n    * ReLU\r\n    * Sigmoid\r\n    * Softmax\r\n    * Tanh\r\n  * Loss:\r\n    * Cross-entropy loss\r\n    * L1 loss\r\n    * L2 loss\r\n    * Log (\"Logistic\") loss\r\n  * Regularization:\r\n    * Dropout\r\n    * L1 reg\r\n    * L2 reg\r\n* Optimizers:\r\n  * Adagrad\r\n  * Adam\r\n  * RMSprop\r\n  * SGD\r\n  * SGD w/ Momentum\r\n  * SGD w/ Nesterov Momentum\r\n* Tests:\r\n  * Gradient Checks\r\n\r\nThe upstream, experimental version of the codebase lives at [https://github.com/dusenberrymw/systemml-nn](https://github.com/dusenberrymw/systemml-nn), and this addition represents the portion of the codebase that is relatively stable.  In particular, vanilla RNNs & LSTMs are currently still in experimental status upstream, but will be added soon.  The idea is to rapidly work on the upstream repo, and then contribute stable pieces to the main SystemML repo.  For now, we will keep this in the `scripts/staging` directory."},"comment":{"url":"https://api.github.com/repos/apache/incubator-systemml/issues/comments/220123260","html_url":"https://github.com/apache/incubator-systemml/pull/160#issuecomment-220123260","issue_url":"https://api.github.com/repos/apache/incubator-systemml/issues/160","id":220123260,"user":{"login":"deroneriksson","id":12634533,"avatar_url":"https://avatars.githubusercontent.com/u/12634533?v=3","gravatar_id":"","url":"https://api.github.com/users/deroneriksson","html_url":"https://github.com/deroneriksson","followers_url":"https://api.github.com/users/deroneriksson/followers","following_url":"https://api.github.com/users/deroneriksson/following{/other_user}","gists_url":"https://api.github.com/users/deroneriksson/gists{/gist_id}","starred_url":"https://api.github.com/users/deroneriksson/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/deroneriksson/subscriptions","organizations_url":"https://api.github.com/users/deroneriksson/orgs","repos_url":"https://api.github.com/users/deroneriksson/repos","events_url":"https://api.github.com/users/deroneriksson/events{/privacy}","received_events_url":"https://api.github.com/users/deroneriksson/received_events","type":"User","site_admin":false},"created_at":"2016-05-18T18:52:48Z","updated_at":"2016-05-18T18:52:48Z","body":"@mboehm7 If tests pass [here](https://sparktc.ibmcloud.com/jenkins/job/SystemML-PullRequestBuilder/393/), can we merge this today for the 0.10.0 release?"}}