{"action":"created","comment":{"url":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/comments/50629012","id":50629012,"diff_hunk":"@@ -0,0 +1,51 @@\n+#!/bin/bash\n+\n+# Copyright 2015 Hossein Hadian\n+\n+cmd=run.pl\n+validation_ratio=5\n+shuffle_buffer_size=5000\n+\n+[ -f ./path.sh ] && . ./path.sh; # source the path.\n+. parse_options.sh || exit 1;\n+\n+echo \"$0 $@\"  # Print the command line for logging\n+\n+if [ $# != 2 ]; then\n+   echo \"Usage: $0 [options] <ali-dir> <duration-model-dir>\"\n+   echo \"e.g.: $0 exp/mono_ali exp/mono/durmod\"\n+   echo \"\"\n+   echo \"Main options (for others, see top of script file):\"\n+   echo \"  --validation-ratio      <number>                 # ratio of validation data over all data. default is 5 (i.e. 5 percent)\"\n+   exit 1;\n+fi\n+\n+alidir=$1\n+dir=$2\n+\n+durmodel=$dir/durmodel.mdl\n+transmodel=$alidir/final.mdl\n+\n+for f in $transmodel $alidir/ali.1.gz; do\n+  [ ! -f $f ] && echo \"$0: Required file not found: $f\" && exit 1;\n+done\n+\n+if [ ! -f $dir/all.ali ]; then\n+  gunzip -c $alidir/ali.*.gz >> $dir/all.ali || exit 1;\n+fi\n+\n+$cmd $dir/log/durmod_make_examples.log \\\n+     nnet3-durmodel-make-egs $durmodel $transmodel ark:$dir/all.ali ark,t:$dir/all.egs || exit 1;","path":"egs/wsj/s5/steps/dur_model/get_examples.sh","position":38,"original_position":38,"commit_id":"bdab829ba182cdb83168dd6d19d7464052bf1ea9","original_commit_id":"bdab829ba182cdb83168dd6d19d7464052bf1ea9","user":{"login":"vijayaditya","id":3895456,"avatar_url":"https://avatars.githubusercontent.com/u/3895456?v=3","gravatar_id":"","url":"https://api.github.com/users/vijayaditya","html_url":"https://github.com/vijayaditya","followers_url":"https://api.github.com/users/vijayaditya/followers","following_url":"https://api.github.com/users/vijayaditya/following{/other_user}","gists_url":"https://api.github.com/users/vijayaditya/gists{/gist_id}","starred_url":"https://api.github.com/users/vijayaditya/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vijayaditya/subscriptions","organizations_url":"https://api.github.com/users/vijayaditya/orgs","repos_url":"https://api.github.com/users/vijayaditya/repos","events_url":"https://api.github.com/users/vijayaditya/events{/privacy}","received_events_url":"https://api.github.com/users/vijayaditya/received_events","type":"User","site_admin":false},"body":"You could directly support the use of 'ark:gunzip -c $alidir/ali.*.gz |' rather than creating a temporary all.ali file","created_at":"2016-01-24T01:56:54Z","updated_at":"2016-01-24T01:56:54Z","html_url":"https://github.com/kaldi-asr/kaldi/pull/414#discussion_r50629012","pull_request_url":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/414","_links":{"self":{"href":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/comments/50629012"},"html":{"href":"https://github.com/kaldi-asr/kaldi/pull/414#discussion_r50629012"},"pull_request":{"href":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/414"}}},"pull_request":{"url":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/414","id":54508198,"html_url":"https://github.com/kaldi-asr/kaldi/pull/414","diff_url":"https://github.com/kaldi-asr/kaldi/pull/414.diff","patch_url":"https://github.com/kaldi-asr/kaldi/pull/414.patch","issue_url":"https://api.github.com/repos/kaldi-asr/kaldi/issues/414","number":414,"state":"open","locked":false,"title":"Phone duration modeling using nnet3","user":{"login":"hhadian","id":15056653,"avatar_url":"https://avatars.githubusercontent.com/u/15056653?v=3","gravatar_id":"","url":"https://api.github.com/users/hhadian","html_url":"https://github.com/hhadian","followers_url":"https://api.github.com/users/hhadian/followers","following_url":"https://api.github.com/users/hhadian/following{/other_user}","gists_url":"https://api.github.com/users/hhadian/gists{/gist_id}","starred_url":"https://api.github.com/users/hhadian/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hhadian/subscriptions","organizations_url":"https://api.github.com/users/hhadian/orgs","repos_url":"https://api.github.com/users/hhadian/repos","events_url":"https://api.github.com/users/hhadian/events{/privacy}","received_events_url":"https://api.github.com/users/hhadian/received_events","type":"User","site_admin":false},"body":"I would be glad to use any suggestions. Thanks in advance.\r\nSome notes:\r\n1. I have tested this code for generating examples and training using nnet3-merge and nnet3-train and the next step is to prepare the rescoring codes.\r\n2. I'm not sure how to determine max_duration_ (in frames) so that we can make sure there is enough training data for all durations. I think, since the approximate distribution of durations is log-normal, we could use log-normal statistics to find a reasonable max_duration_ using mean and variance for eg.\r\nThe other way is to find the maximum phone duration d such that there is at least 1 training phone for all durations d-1, d-2,... too. \r\n3. Should I put my name as the author for the new source files ? For now I have put no author names (just Johns Hopkins University).\r\n\r\nThank you.\r\n","created_at":"2015-12-23T21:26:45Z","updated_at":"2016-01-24T01:56:54Z","closed_at":null,"merged_at":null,"merge_commit_sha":"f98ea1cef08a96c8a98114c6144c3fa0eb56ea1e","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/414/commits","review_comments_url":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/414/comments","review_comment_url":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/comments{/number}","comments_url":"https://api.github.com/repos/kaldi-asr/kaldi/issues/414/comments","statuses_url":"https://api.github.com/repos/kaldi-asr/kaldi/statuses/bdab829ba182cdb83168dd6d19d7464052bf1ea9","head":{"label":"hhadian:duration-model","ref":"duration-model","sha":"bdab829ba182cdb83168dd6d19d7464052bf1ea9","user":{"login":"hhadian","id":15056653,"avatar_url":"https://avatars.githubusercontent.com/u/15056653?v=3","gravatar_id":"","url":"https://api.github.com/users/hhadian","html_url":"https://github.com/hhadian","followers_url":"https://api.github.com/users/hhadian/followers","following_url":"https://api.github.com/users/hhadian/following{/other_user}","gists_url":"https://api.github.com/users/hhadian/gists{/gist_id}","starred_url":"https://api.github.com/users/hhadian/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hhadian/subscriptions","organizations_url":"https://api.github.com/users/hhadian/orgs","repos_url":"https://api.github.com/users/hhadian/repos","events_url":"https://api.github.com/users/hhadian/events{/privacy}","received_events_url":"https://api.github.com/users/hhadian/received_events","type":"User","site_admin":false},"repo":{"id":44244555,"name":"kaldi","full_name":"hhadian/kaldi","owner":{"login":"hhadian","id":15056653,"avatar_url":"https://avatars.githubusercontent.com/u/15056653?v=3","gravatar_id":"","url":"https://api.github.com/users/hhadian","html_url":"https://github.com/hhadian","followers_url":"https://api.github.com/users/hhadian/followers","following_url":"https://api.github.com/users/hhadian/following{/other_user}","gists_url":"https://api.github.com/users/hhadian/gists{/gist_id}","starred_url":"https://api.github.com/users/hhadian/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hhadian/subscriptions","organizations_url":"https://api.github.com/users/hhadian/orgs","repos_url":"https://api.github.com/users/hhadian/repos","events_url":"https://api.github.com/users/hhadian/events{/privacy}","received_events_url":"https://api.github.com/users/hhadian/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/hhadian/kaldi","description":"This is now the official location of the Kaldi project.","fork":true,"url":"https://api.github.com/repos/hhadian/kaldi","forks_url":"https://api.github.com/repos/hhadian/kaldi/forks","keys_url":"https://api.github.com/repos/hhadian/kaldi/keys{/key_id}","collaborators_url":"https://api.github.com/repos/hhadian/kaldi/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/hhadian/kaldi/teams","hooks_url":"https://api.github.com/repos/hhadian/kaldi/hooks","issue_events_url":"https://api.github.com/repos/hhadian/kaldi/issues/events{/number}","events_url":"https://api.github.com/repos/hhadian/kaldi/events","assignees_url":"https://api.github.com/repos/hhadian/kaldi/assignees{/user}","branches_url":"https://api.github.com/repos/hhadian/kaldi/branches{/branch}","tags_url":"https://api.github.com/repos/hhadian/kaldi/tags","blobs_url":"https://api.github.com/repos/hhadian/kaldi/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/hhadian/kaldi/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/hhadian/kaldi/git/refs{/sha}","trees_url":"https://api.github.com/repos/hhadian/kaldi/git/trees{/sha}","statuses_url":"https://api.github.com/repos/hhadian/kaldi/statuses/{sha}","languages_url":"https://api.github.com/repos/hhadian/kaldi/languages","stargazers_url":"https://api.github.com/repos/hhadian/kaldi/stargazers","contributors_url":"https://api.github.com/repos/hhadian/kaldi/contributors","subscribers_url":"https://api.github.com/repos/hhadian/kaldi/subscribers","subscription_url":"https://api.github.com/repos/hhadian/kaldi/subscription","commits_url":"https://api.github.com/repos/hhadian/kaldi/commits{/sha}","git_commits_url":"https://api.github.com/repos/hhadian/kaldi/git/commits{/sha}","comments_url":"https://api.github.com/repos/hhadian/kaldi/comments{/number}","issue_comment_url":"https://api.github.com/repos/hhadian/kaldi/issues/comments{/number}","contents_url":"https://api.github.com/repos/hhadian/kaldi/contents/{+path}","compare_url":"https://api.github.com/repos/hhadian/kaldi/compare/{base}...{head}","merges_url":"https://api.github.com/repos/hhadian/kaldi/merges","archive_url":"https://api.github.com/repos/hhadian/kaldi/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/hhadian/kaldi/downloads","issues_url":"https://api.github.com/repos/hhadian/kaldi/issues{/number}","pulls_url":"https://api.github.com/repos/hhadian/kaldi/pulls{/number}","milestones_url":"https://api.github.com/repos/hhadian/kaldi/milestones{/number}","notifications_url":"https://api.github.com/repos/hhadian/kaldi/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/hhadian/kaldi/labels{/name}","releases_url":"https://api.github.com/repos/hhadian/kaldi/releases{/id}","deployments_url":"https://api.github.com/repos/hhadian/kaldi/deployments","created_at":"2015-10-14T11:55:09Z","updated_at":"2016-01-23T09:33:53Z","pushed_at":"2016-01-23T09:33:37Z","git_url":"git://github.com/hhadian/kaldi.git","ssh_url":"git@github.com:hhadian/kaldi.git","clone_url":"https://github.com/hhadian/kaldi.git","svn_url":"https://github.com/hhadian/kaldi","homepage":"http://kaldi-asr.org","size":75411,"stargazers_count":0,"watchers_count":0,"language":"C++","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"kaldi-asr:master","ref":"master","sha":"61a551d8f7d4c7cf8ef30d05ab61956cb3999eed","user":{"login":"kaldi-asr","id":11650082,"avatar_url":"https://avatars.githubusercontent.com/u/11650082?v=3","gravatar_id":"","url":"https://api.github.com/users/kaldi-asr","html_url":"https://github.com/kaldi-asr","followers_url":"https://api.github.com/users/kaldi-asr/followers","following_url":"https://api.github.com/users/kaldi-asr/following{/other_user}","gists_url":"https://api.github.com/users/kaldi-asr/gists{/gist_id}","starred_url":"https://api.github.com/users/kaldi-asr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kaldi-asr/subscriptions","organizations_url":"https://api.github.com/users/kaldi-asr/orgs","repos_url":"https://api.github.com/users/kaldi-asr/repos","events_url":"https://api.github.com/users/kaldi-asr/events{/privacy}","received_events_url":"https://api.github.com/users/kaldi-asr/received_events","type":"Organization","site_admin":false},"repo":{"id":34275045,"name":"kaldi","full_name":"kaldi-asr/kaldi","owner":{"login":"kaldi-asr","id":11650082,"avatar_url":"https://avatars.githubusercontent.com/u/11650082?v=3","gravatar_id":"","url":"https://api.github.com/users/kaldi-asr","html_url":"https://github.com/kaldi-asr","followers_url":"https://api.github.com/users/kaldi-asr/followers","following_url":"https://api.github.com/users/kaldi-asr/following{/other_user}","gists_url":"https://api.github.com/users/kaldi-asr/gists{/gist_id}","starred_url":"https://api.github.com/users/kaldi-asr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kaldi-asr/subscriptions","organizations_url":"https://api.github.com/users/kaldi-asr/orgs","repos_url":"https://api.github.com/users/kaldi-asr/repos","events_url":"https://api.github.com/users/kaldi-asr/events{/privacy}","received_events_url":"https://api.github.com/users/kaldi-asr/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/kaldi-asr/kaldi","description":"This is now the official location of the Kaldi project.","fork":false,"url":"https://api.github.com/repos/kaldi-asr/kaldi","forks_url":"https://api.github.com/repos/kaldi-asr/kaldi/forks","keys_url":"https://api.github.com/repos/kaldi-asr/kaldi/keys{/key_id}","collaborators_url":"https://api.github.com/repos/kaldi-asr/kaldi/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/kaldi-asr/kaldi/teams","hooks_url":"https://api.github.com/repos/kaldi-asr/kaldi/hooks","issue_events_url":"https://api.github.com/repos/kaldi-asr/kaldi/issues/events{/number}","events_url":"https://api.github.com/repos/kaldi-asr/kaldi/events","assignees_url":"https://api.github.com/repos/kaldi-asr/kaldi/assignees{/user}","branches_url":"https://api.github.com/repos/kaldi-asr/kaldi/branches{/branch}","tags_url":"https://api.github.com/repos/kaldi-asr/kaldi/tags","blobs_url":"https://api.github.com/repos/kaldi-asr/kaldi/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/kaldi-asr/kaldi/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/kaldi-asr/kaldi/git/refs{/sha}","trees_url":"https://api.github.com/repos/kaldi-asr/kaldi/git/trees{/sha}","statuses_url":"https://api.github.com/repos/kaldi-asr/kaldi/statuses/{sha}","languages_url":"https://api.github.com/repos/kaldi-asr/kaldi/languages","stargazers_url":"https://api.github.com/repos/kaldi-asr/kaldi/stargazers","contributors_url":"https://api.github.com/repos/kaldi-asr/kaldi/contributors","subscribers_url":"https://api.github.com/repos/kaldi-asr/kaldi/subscribers","subscription_url":"https://api.github.com/repos/kaldi-asr/kaldi/subscription","commits_url":"https://api.github.com/repos/kaldi-asr/kaldi/commits{/sha}","git_commits_url":"https://api.github.com/repos/kaldi-asr/kaldi/git/commits{/sha}","comments_url":"https://api.github.com/repos/kaldi-asr/kaldi/comments{/number}","issue_comment_url":"https://api.github.com/repos/kaldi-asr/kaldi/issues/comments{/number}","contents_url":"https://api.github.com/repos/kaldi-asr/kaldi/contents/{+path}","compare_url":"https://api.github.com/repos/kaldi-asr/kaldi/compare/{base}...{head}","merges_url":"https://api.github.com/repos/kaldi-asr/kaldi/merges","archive_url":"https://api.github.com/repos/kaldi-asr/kaldi/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/kaldi-asr/kaldi/downloads","issues_url":"https://api.github.com/repos/kaldi-asr/kaldi/issues{/number}","pulls_url":"https://api.github.com/repos/kaldi-asr/kaldi/pulls{/number}","milestones_url":"https://api.github.com/repos/kaldi-asr/kaldi/milestones{/number}","notifications_url":"https://api.github.com/repos/kaldi-asr/kaldi/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/kaldi-asr/kaldi/labels{/name}","releases_url":"https://api.github.com/repos/kaldi-asr/kaldi/releases{/id}","deployments_url":"https://api.github.com/repos/kaldi-asr/kaldi/deployments","created_at":"2015-04-20T17:23:16Z","updated_at":"2016-01-23T18:49:20Z","pushed_at":"2016-01-24T00:04:31Z","git_url":"git://github.com/kaldi-asr/kaldi.git","ssh_url":"git@github.com:kaldi-asr/kaldi.git","clone_url":"https://github.com/kaldi-asr/kaldi.git","svn_url":"https://github.com/kaldi-asr/kaldi","homepage":"http://kaldi-asr.org","size":111452,"stargazers_count":384,"watchers_count":384,"language":"C++","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":246,"mirror_url":null,"open_issues_count":30,"forks":246,"open_issues":30,"watchers":384,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/414"},"html":{"href":"https://github.com/kaldi-asr/kaldi/pull/414"},"issue":{"href":"https://api.github.com/repos/kaldi-asr/kaldi/issues/414"},"comments":{"href":"https://api.github.com/repos/kaldi-asr/kaldi/issues/414/comments"},"review_comments":{"href":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/414/comments"},"review_comment":{"href":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/kaldi-asr/kaldi/pulls/414/commits"},"statuses":{"href":"https://api.github.com/repos/kaldi-asr/kaldi/statuses/bdab829ba182cdb83168dd6d19d7464052bf1ea9"}}}}