{"action":"closed","issue":{"url":"https://api.github.com/repos/PaddlePaddle/models/issues/3","repository_url":"https://api.github.com/repos/PaddlePaddle/models","labels_url":"https://api.github.com/repos/PaddlePaddle/models/issues/3/labels{/name}","comments_url":"https://api.github.com/repos/PaddlePaddle/models/issues/3/comments","events_url":"https://api.github.com/repos/PaddlePaddle/models/issues/3/events","html_url":"https://github.com/PaddlePaddle/models/issues/3","id":223329340,"node_id":"MDU6SXNzdWUyMjMzMjkzNDA=","number":3,"title":"example configuration for language model.","user":{"login":"lcy-seso","id":5842774,"node_id":"MDQ6VXNlcjU4NDI3NzQ=","avatar_url":"https://avatars2.githubusercontent.com/u/5842774?v=4","gravatar_id":"","url":"https://api.github.com/users/lcy-seso","html_url":"https://github.com/lcy-seso","followers_url":"https://api.github.com/users/lcy-seso/followers","following_url":"https://api.github.com/users/lcy-seso/following{/other_user}","gists_url":"https://api.github.com/users/lcy-seso/gists{/gist_id}","starred_url":"https://api.github.com/users/lcy-seso/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lcy-seso/subscriptions","organizations_url":"https://api.github.com/users/lcy-seso/orgs","repos_url":"https://api.github.com/users/lcy-seso/repos","events_url":"https://api.github.com/users/lcy-seso/events{/privacy}","received_events_url":"https://api.github.com/users/lcy-seso/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":{"login":"chengxiaohua1105","id":24726507,"node_id":"MDQ6VXNlcjI0NzI2NTA3","avatar_url":"https://avatars2.githubusercontent.com/u/24726507?v=4","gravatar_id":"","url":"https://api.github.com/users/chengxiaohua1105","html_url":"https://github.com/chengxiaohua1105","followers_url":"https://api.github.com/users/chengxiaohua1105/followers","following_url":"https://api.github.com/users/chengxiaohua1105/following{/other_user}","gists_url":"https://api.github.com/users/chengxiaohua1105/gists{/gist_id}","starred_url":"https://api.github.com/users/chengxiaohua1105/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chengxiaohua1105/subscriptions","organizations_url":"https://api.github.com/users/chengxiaohua1105/orgs","repos_url":"https://api.github.com/users/chengxiaohua1105/repos","events_url":"https://api.github.com/users/chengxiaohua1105/events{/privacy}","received_events_url":"https://api.github.com/users/chengxiaohua1105/received_events","type":"User","site_admin":false},"assignees":[{"login":"chengxiaohua1105","id":24726507,"node_id":"MDQ6VXNlcjI0NzI2NTA3","avatar_url":"https://avatars2.githubusercontent.com/u/24726507?v=4","gravatar_id":"","url":"https://api.github.com/users/chengxiaohua1105","html_url":"https://github.com/chengxiaohua1105","followers_url":"https://api.github.com/users/chengxiaohua1105/followers","following_url":"https://api.github.com/users/chengxiaohua1105/following{/other_user}","gists_url":"https://api.github.com/users/chengxiaohua1105/gists{/gist_id}","starred_url":"https://api.github.com/users/chengxiaohua1105/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chengxiaohua1105/subscriptions","organizations_url":"https://api.github.com/users/chengxiaohua1105/orgs","repos_url":"https://api.github.com/users/chengxiaohua1105/repos","events_url":"https://api.github.com/users/chengxiaohua1105/events{/privacy}","received_events_url":"https://api.github.com/users/chengxiaohua1105/received_events","type":"User","site_admin":false}],"milestone":null,"comments":3,"created_at":"2017-04-21T09:28:57Z","updated_at":"2018-08-15T09:59:45Z","closed_at":"2018-08-15T09:59:45Z","author_association":"COLLABORATOR","body":"- In this example, we would like to show how to **train**:\r\n    1. a n-gram language model (please refer to [this](https://github.com/lcy-seso/paddle_confs_v1/blob/master/language_model/ngram_language_model.conf) configuration file written in old PaddlePaddle API）\r\n    2. a rnn/lstm language model  (please refer to [this](https://github.com/lcy-seso/paddle_confs_v1/blob/master/language_model/rnn_language_model.conf) configuration file written in old PaddlePaddle API)\r\n\r\n- Besides, we would like to show how to **generate sequence** from:\r\n    1. a N-gram language\r\n    2. a rnn language model\r\n\r\n- In the generation process, please consider the following two situations:\r\n    1. generate a sequence by using [paddle.infer](https://github.com/PaddlePaddle/Paddle/blob/develop/python/paddle/v2/inference.py#L73) API, in which you need to implement one-way search or beam search (beam search is more complicated, I suggest to implement one-way search first.)\r\n    2. generate a sequence by using recurrent_layer_group\r\n\r\n- Please consider to use the following data for training and add these datasets into `paddle.dataset` package.\r\n    1. [1billionword-training](https://github.com/ciprian-chelba/1-billion-word-language-modeling-benchmark), [1 billionword-test](https://github.com/tensorflow/models/tree/master/lm_1b) \r\n    2. [ptb](https://github.com/facebook/SCRNNs)\r\n\r\n- Please pull your codes and docs into the [language_model](https://github.com/PaddlePaddle/models/tree/develop/language_model) directory."}}
{"actor":{"display_login":"shanyi15"}}