{"action":"created","comment":{"url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/comments/60394364","id":60394364,"diff_hunk":"@@ -41,18 +41,18 @@ \\subsection{Markov Decision Processes}\n \\reward(\\st,\\action) = \\EE{ \\Reward_{(\\st,\\action)} }.\n \\]\n % In what follows, we shall assume that the rewards are bounded by some quantity $\\rewardrange>0$: for any $(\\st,\\action)\\in\\States\\times\\Actions$, $|\\Reward_{(\\st,\\action)}|\\le \\rewardrange$ almost surely.\n-以下において，報酬はある値$\\rewardrange>0$について，任意の$(\\st,\\action)\\in\\States\\times\\Actions$でほとんど確実に$|\\Reward_{(\\st,\\action)}|\\le \\rewardrange$であるとする．\n+以下において，報酬はある値$\\rewardrange>0$で抑えることができるとして，任意の$(\\st,\\action)\\in\\States\\times\\Actions$でほとんど確実に$|\\Reward_{(\\st,\\action)}|\\le \\rewardrange$であるとする．\n \\myfootnote{\n % ``Almost surely'' means the same as ``with probability one'' and is used to refer to the fact that the statement concerned holds everywhere on the probability space with the exception of a set of events with measure zero.\n-「ほとんど確実に」というのは「確率１で」とほとんど同義で，確率空間のいたるところで測度0の事象の集合の例外が生じることについて言及している．\n+「ほとんど確実に」というのは「確率１で」とほとんど同義で，確率空間のいたるところで測度0の事象の集合に含まれる例外が存在することについて言及している．\n }\n % It is immediate that if the random rewards are bounded by $\\rewardrange$ then  $\\|\\reward\\|_\\infty = \\sup_{(\\st,\\action)\\in\\States\\times \\Actions} |\\reward(\\st,\\action)| \\le \\rewardrange$ also holds.\n 確率的な報酬が$\\rewardrange$以下であるとき，$\\|\\reward\\|_\\infty = \\sup_{(\\st,\\action)\\in\\States\\times \\Actions} |\\reward(\\st,\\action)| \\le \\rewardrange$は直ちに成立する．\n % An MDP is called {\\em finite} if both $\\States$ and $\\Actions$ are finite.\n-$\\States$と$\\Actions$が有限の時MDPは有限であるという．\n+$\\States$と$\\Actions$が有限のとき，MDPは有限であるという．\n \n % Markov Decision Processes are a tool for modeling sequential decision-making problems where a decision maker interacts with a system in a sequential fashion.\n-マルコフ決定過程は意思決定者がシステムと連続して相互に影響しあうような系列の意思決定問題をモデル化するための道具である．\n+マルコフ決定過程は意思決定者がシステムと逐次形式で相互作用する系列の意思決定問題をモデル化するための道具である．\n % Given an MDP $\\MDP$, this interaction happens as follows:\n MDPを$\\MDP$とすると，相互作用は以下のように表される：","path":"tex/220-markov-decision-processes.tex","position":48,"original_position":48,"commit_id":"f7b2316f71439fb39672c6ebfe7f932aaa148686","original_commit_id":"f7b2316f71439fb39672c6ebfe7f932aaa148686","user":{"login":"smochi","id":6184232,"avatar_url":"https://avatars.githubusercontent.com/u/6184232?v=3","gravatar_id":"","url":"https://api.github.com/users/smochi","html_url":"https://github.com/smochi","followers_url":"https://api.github.com/users/smochi/followers","following_url":"https://api.github.com/users/smochi/following{/other_user}","gists_url":"https://api.github.com/users/smochi/gists{/gist_id}","starred_url":"https://api.github.com/users/smochi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/smochi/subscriptions","organizations_url":"https://api.github.com/users/smochi/orgs","repos_url":"https://api.github.com/users/smochi/repos","events_url":"https://api.github.com/users/smochi/events{/privacy}","received_events_url":"https://api.github.com/users/smochi/received_events","type":"User","site_admin":false},"body":"MDPを$\\MDP$とすると→MDP$\\MDP$が与えられるとき、相互作用は以下のように→相互作用は次のように起こる","created_at":"2016-04-20T11:58:56Z","updated_at":"2016-04-20T11:58:56Z","html_url":"https://github.com/sotetsuk/algo-rl-ja/pull/33#discussion_r60394364","pull_request_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/33","_links":{"self":{"href":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/comments/60394364"},"html":{"href":"https://github.com/sotetsuk/algo-rl-ja/pull/33#discussion_r60394364"},"pull_request":{"href":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/33"}}},"pull_request":{"url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/33","id":66659604,"html_url":"https://github.com/sotetsuk/algo-rl-ja/pull/33","diff_url":"https://github.com/sotetsuk/algo-rl-ja/pull/33.diff","patch_url":"https://github.com/sotetsuk/algo-rl-ja/pull/33.patch","issue_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues/33","number":33,"state":"open","locked":false,"title":"@smochi による校閲・修正","user":{"login":"smochi","id":6184232,"avatar_url":"https://avatars.githubusercontent.com/u/6184232?v=3","gravatar_id":"","url":"https://api.github.com/users/smochi","html_url":"https://github.com/smochi","followers_url":"https://api.github.com/users/smochi/followers","following_url":"https://api.github.com/users/smochi/following{/other_user}","gists_url":"https://api.github.com/users/smochi/gists{/gist_id}","starred_url":"https://api.github.com/users/smochi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/smochi/subscriptions","organizations_url":"https://api.github.com/users/smochi/orgs","repos_url":"https://api.github.com/users/smochi/repos","events_url":"https://api.github.com/users/smochi/events{/privacy}","received_events_url":"https://api.github.com/users/smochi/received_events","type":"User","site_admin":false},"body":"#28 \r\n\r\n# TODO\r\n- [x] 担当者が新しくブランチとプルリクを作る\r\n- [x] 担当者が訳を修正する\r\n- [x] 皆にコメントをつけるようアナウンスする\r\n- [ ] 勉強会後、コメントを反映して修正（この際、監修への積み残しのコメントを①に書き残す）\r\n- [ ] 専門用語リスト，not専門用語リストを更新する\r\n- [ ] @sotetsukにアサインを変更\r\n- [ ] @sotetsukが確認の上マージ\r\n\r\n専門用語はGoogleスプレッドシートで編集し、@sotetsukが適宜プッシュします\r\n列は左から単語、正訳、誤訳例、エビデンスです\r\n- [専門用語リスト](https://docs.google.com/spreadsheets/d/1L0WpAi5asJ-I4c2iQ6WH3N8tOSfQASKoipV2dJXwsQo/edit?usp=sharing)（28〜）\r\n- [not専門用語リスト](https://docs.google.com/spreadsheets/d/1IHfHLoLeUqv0m8w9ynVFc5L0uYFht8nQPXH4QUHohgg/edit?usp=sharing)（24〜）","created_at":"2016-04-15T15:19:26Z","updated_at":"2016-04-20T11:58:56Z","closed_at":null,"merged_at":null,"merge_commit_sha":"3353382ebe4c3de2cce0a9719a08d5f91a4e97c3","assignee":{"login":"smochi","id":6184232,"avatar_url":"https://avatars.githubusercontent.com/u/6184232?v=3","gravatar_id":"","url":"https://api.github.com/users/smochi","html_url":"https://github.com/smochi","followers_url":"https://api.github.com/users/smochi/followers","following_url":"https://api.github.com/users/smochi/following{/other_user}","gists_url":"https://api.github.com/users/smochi/gists{/gist_id}","starred_url":"https://api.github.com/users/smochi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/smochi/subscriptions","organizations_url":"https://api.github.com/users/smochi/orgs","repos_url":"https://api.github.com/users/smochi/repos","events_url":"https://api.github.com/users/smochi/events{/privacy}","received_events_url":"https://api.github.com/users/smochi/received_events","type":"User","site_admin":false},"milestone":null,"commits_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/33/commits","review_comments_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/33/comments","review_comment_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/comments{/number}","comments_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues/33/comments","statuses_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/statuses/f7b2316f71439fb39672c6ebfe7f932aaa148686","head":{"label":"sotetsuk:original-and-ja-p7p12-3","ref":"original-and-ja-p7p12-3","sha":"f7b2316f71439fb39672c6ebfe7f932aaa148686","user":{"login":"sotetsuk","id":5868442,"avatar_url":"https://avatars.githubusercontent.com/u/5868442?v=3","gravatar_id":"","url":"https://api.github.com/users/sotetsuk","html_url":"https://github.com/sotetsuk","followers_url":"https://api.github.com/users/sotetsuk/followers","following_url":"https://api.github.com/users/sotetsuk/following{/other_user}","gists_url":"https://api.github.com/users/sotetsuk/gists{/gist_id}","starred_url":"https://api.github.com/users/sotetsuk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sotetsuk/subscriptions","organizations_url":"https://api.github.com/users/sotetsuk/orgs","repos_url":"https://api.github.com/users/sotetsuk/repos","events_url":"https://api.github.com/users/sotetsuk/events{/privacy}","received_events_url":"https://api.github.com/users/sotetsuk/received_events","type":"User","site_admin":false},"repo":{"id":54883462,"name":"algo-rl-ja","full_name":"sotetsuk/algo-rl-ja","owner":{"login":"sotetsuk","id":5868442,"avatar_url":"https://avatars.githubusercontent.com/u/5868442?v=3","gravatar_id":"","url":"https://api.github.com/users/sotetsuk","html_url":"https://github.com/sotetsuk","followers_url":"https://api.github.com/users/sotetsuk/followers","following_url":"https://api.github.com/users/sotetsuk/following{/other_user}","gists_url":"https://api.github.com/users/sotetsuk/gists{/gist_id}","starred_url":"https://api.github.com/users/sotetsuk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sotetsuk/subscriptions","organizations_url":"https://api.github.com/users/sotetsuk/orgs","repos_url":"https://api.github.com/users/sotetsuk/repos","events_url":"https://api.github.com/users/sotetsuk/events{/privacy}","received_events_url":"https://api.github.com/users/sotetsuk/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/sotetsuk/algo-rl-ja","description":"Japanese translation of Algorithms for Reinforcement Learning (http://www.ualberta.ca/~szepesva/RLBook.html)","fork":false,"url":"https://api.github.com/repos/sotetsuk/algo-rl-ja","forks_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/forks","keys_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/keys{/key_id}","collaborators_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/teams","hooks_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/hooks","issue_events_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues/events{/number}","events_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/events","assignees_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/assignees{/user}","branches_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/branches{/branch}","tags_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/tags","blobs_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/refs{/sha}","trees_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/trees{/sha}","statuses_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/statuses/{sha}","languages_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/languages","stargazers_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/stargazers","contributors_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/contributors","subscribers_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/subscribers","subscription_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/subscription","commits_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/commits{/sha}","git_commits_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/commits{/sha}","comments_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/comments{/number}","issue_comment_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues/comments{/number}","contents_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/contents/{+path}","compare_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/compare/{base}...{head}","merges_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/merges","archive_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/downloads","issues_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues{/number}","pulls_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls{/number}","milestones_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/milestones{/number}","notifications_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/labels{/name}","releases_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/releases{/id}","deployments_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/deployments","created_at":"2016-03-28T10:02:03Z","updated_at":"2016-04-15T15:01:35Z","pushed_at":"2016-04-20T09:54:09Z","git_url":"git://github.com/sotetsuk/algo-rl-ja.git","ssh_url":"git@github.com:sotetsuk/algo-rl-ja.git","clone_url":"https://github.com/sotetsuk/algo-rl-ja.git","svn_url":"https://github.com/sotetsuk/algo-rl-ja","homepage":null,"size":1503,"stargazers_count":6,"watchers_count":6,"language":"TeX","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":1,"mirror_url":null,"open_issues_count":8,"forks":1,"open_issues":8,"watchers":6,"default_branch":"master"}},"base":{"label":"sotetsuk:master","ref":"master","sha":"ee43c7f02bee4e177b63e35c1f7352079c516d52","user":{"login":"sotetsuk","id":5868442,"avatar_url":"https://avatars.githubusercontent.com/u/5868442?v=3","gravatar_id":"","url":"https://api.github.com/users/sotetsuk","html_url":"https://github.com/sotetsuk","followers_url":"https://api.github.com/users/sotetsuk/followers","following_url":"https://api.github.com/users/sotetsuk/following{/other_user}","gists_url":"https://api.github.com/users/sotetsuk/gists{/gist_id}","starred_url":"https://api.github.com/users/sotetsuk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sotetsuk/subscriptions","organizations_url":"https://api.github.com/users/sotetsuk/orgs","repos_url":"https://api.github.com/users/sotetsuk/repos","events_url":"https://api.github.com/users/sotetsuk/events{/privacy}","received_events_url":"https://api.github.com/users/sotetsuk/received_events","type":"User","site_admin":false},"repo":{"id":54883462,"name":"algo-rl-ja","full_name":"sotetsuk/algo-rl-ja","owner":{"login":"sotetsuk","id":5868442,"avatar_url":"https://avatars.githubusercontent.com/u/5868442?v=3","gravatar_id":"","url":"https://api.github.com/users/sotetsuk","html_url":"https://github.com/sotetsuk","followers_url":"https://api.github.com/users/sotetsuk/followers","following_url":"https://api.github.com/users/sotetsuk/following{/other_user}","gists_url":"https://api.github.com/users/sotetsuk/gists{/gist_id}","starred_url":"https://api.github.com/users/sotetsuk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sotetsuk/subscriptions","organizations_url":"https://api.github.com/users/sotetsuk/orgs","repos_url":"https://api.github.com/users/sotetsuk/repos","events_url":"https://api.github.com/users/sotetsuk/events{/privacy}","received_events_url":"https://api.github.com/users/sotetsuk/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/sotetsuk/algo-rl-ja","description":"Japanese translation of Algorithms for Reinforcement Learning (http://www.ualberta.ca/~szepesva/RLBook.html)","fork":false,"url":"https://api.github.com/repos/sotetsuk/algo-rl-ja","forks_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/forks","keys_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/keys{/key_id}","collaborators_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/teams","hooks_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/hooks","issue_events_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues/events{/number}","events_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/events","assignees_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/assignees{/user}","branches_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/branches{/branch}","tags_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/tags","blobs_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/refs{/sha}","trees_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/trees{/sha}","statuses_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/statuses/{sha}","languages_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/languages","stargazers_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/stargazers","contributors_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/contributors","subscribers_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/subscribers","subscription_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/subscription","commits_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/commits{/sha}","git_commits_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/git/commits{/sha}","comments_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/comments{/number}","issue_comment_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues/comments{/number}","contents_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/contents/{+path}","compare_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/compare/{base}...{head}","merges_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/merges","archive_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/downloads","issues_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues{/number}","pulls_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls{/number}","milestones_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/milestones{/number}","notifications_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/labels{/name}","releases_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/releases{/id}","deployments_url":"https://api.github.com/repos/sotetsuk/algo-rl-ja/deployments","created_at":"2016-03-28T10:02:03Z","updated_at":"2016-04-15T15:01:35Z","pushed_at":"2016-04-20T09:54:09Z","git_url":"git://github.com/sotetsuk/algo-rl-ja.git","ssh_url":"git@github.com:sotetsuk/algo-rl-ja.git","clone_url":"https://github.com/sotetsuk/algo-rl-ja.git","svn_url":"https://github.com/sotetsuk/algo-rl-ja","homepage":null,"size":1503,"stargazers_count":6,"watchers_count":6,"language":"TeX","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":1,"mirror_url":null,"open_issues_count":8,"forks":1,"open_issues":8,"watchers":6,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/33"},"html":{"href":"https://github.com/sotetsuk/algo-rl-ja/pull/33"},"issue":{"href":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues/33"},"comments":{"href":"https://api.github.com/repos/sotetsuk/algo-rl-ja/issues/33/comments"},"review_comments":{"href":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/33/comments"},"review_comment":{"href":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/sotetsuk/algo-rl-ja/pulls/33/commits"},"statuses":{"href":"https://api.github.com/repos/sotetsuk/algo-rl-ja/statuses/f7b2316f71439fb39672c6ebfe7f932aaa148686"}}}}