{"action":"created","issue":{"url":"https://api.github.com/repos/ufal/neuralmonkey/issues/14","repository_url":"https://api.github.com/repos/ufal/neuralmonkey","labels_url":"https://api.github.com/repos/ufal/neuralmonkey/issues/14/labels{/name}","comments_url":"https://api.github.com/repos/ufal/neuralmonkey/issues/14/comments","events_url":"https://api.github.com/repos/ufal/neuralmonkey/issues/14/events","html_url":"https://github.com/ufal/neuralmonkey/issues/14","id":161865773,"number":14,"title":"Ensembles","user":{"login":"jindrahelcl","id":1842355,"avatar_url":"https://avatars.githubusercontent.com/u/1842355?v=3","gravatar_id":"","url":"https://api.github.com/users/jindrahelcl","html_url":"https://github.com/jindrahelcl","followers_url":"https://api.github.com/users/jindrahelcl/followers","following_url":"https://api.github.com/users/jindrahelcl/following{/other_user}","gists_url":"https://api.github.com/users/jindrahelcl/gists{/gist_id}","starred_url":"https://api.github.com/users/jindrahelcl/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jindrahelcl/subscriptions","organizations_url":"https://api.github.com/users/jindrahelcl/orgs","repos_url":"https://api.github.com/users/jindrahelcl/repos","events_url":"https://api.github.com/users/jindrahelcl/events{/privacy}","received_events_url":"https://api.github.com/users/jindrahelcl/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/ufal/neuralmonkey/labels/feature","name":"feature","color":"0052cc"}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2016-06-23T08:21:22Z","updated_at":"2016-07-29T15:29:41Z","closed_at":null,"body":"Write support for ensemble models.\r\n\r\nThe idea is, in the end, to give the running script multiple *.ini files (or one with links to another experiments)."},"comment":{"url":"https://api.github.com/repos/ufal/neuralmonkey/issues/comments/236212062","html_url":"https://github.com/ufal/neuralmonkey/issues/14#issuecomment-236212062","issue_url":"https://api.github.com/repos/ufal/neuralmonkey/issues/14","id":236212062,"user":{"login":"jlibovicky","id":1221979,"avatar_url":"https://avatars.githubusercontent.com/u/1221979?v=3","gravatar_id":"","url":"https://api.github.com/users/jlibovicky","html_url":"https://github.com/jlibovicky","followers_url":"https://api.github.com/users/jlibovicky/followers","following_url":"https://api.github.com/users/jlibovicky/following{/other_user}","gists_url":"https://api.github.com/users/jlibovicky/gists{/gist_id}","starred_url":"https://api.github.com/users/jlibovicky/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jlibovicky/subscriptions","organizations_url":"https://api.github.com/users/jlibovicky/orgs","repos_url":"https://api.github.com/users/jlibovicky/repos","events_url":"https://api.github.com/users/jlibovicky/events{/privacy}","received_events_url":"https://api.github.com/users/jlibovicky/received_events","type":"User","site_admin":false},"created_at":"2016-07-29T15:29:41Z","updated_at":"2016-07-29T15:29:41Z","body":"ad předchozí: Jo, to by se muselo pustit tolikrát, kolik modelů chceme ensemblovat.\r\n\r\nad poslední: To je ale slabší model, než to o čem jsem mluvil. Zadarmo by to bylo v Theanu, kde ten graf je stateless, taky jsou ty variables přímo součástí toho grafu, tak to chce zjistit, jak dlouho trvá vyměnit ty proměnné. Problém bych viděl taky v tom, že věty, co vydají jednotlivé dekodéry, můžou mít různou délku. Delší věty žijou v mnohem větším pravděpodobnostním prostoru, takže jednotlivci tam mají výrazně menší pravděpodobnost. Takže by bylo potřeba to normalizovat (a asi to bude fungovat)\r\n\r\nKdybysme to ensemblovali na úrovni těch jednotlivých výstupů, tak například můžeme spravit,  že jeden dekodér se zblázní a obrovskou pravděpodobností vydá jedno slovo špatně, ostatní ho přehlasujou a on už jede v pohodě. Nevím ale, jak to tohle udělat s tím n-bestem.\r\n\r\nMožná bych to zkusil nějak ohackovat. Ten *.meta soubor vypadá, že by to mohl být protobuffer a jsou tam napsaný jména těch proměnných. Ten by se dal naparsovat a přidat těm proměnným nějaké prefixy a pak při stavění grafu tak pojmenovat variable scopy, kde bude žít ten model. Ale je to je to samozřejmě hrozmě moc práce."}}
{"actor":{"display_login":"jlibovicky"}}