{"action":"created","issue":{"url":"https://api.github.com/repos/schrum2/MM-NEAT/issues/25","repository_url":"https://api.github.com/repos/schrum2/MM-NEAT","labels_url":"https://api.github.com/repos/schrum2/MM-NEAT/issues/25/labels{/name}","comments_url":"https://api.github.com/repos/schrum2/MM-NEAT/issues/25/comments","events_url":"https://api.github.com/repos/schrum2/MM-NEAT/issues/25/events","html_url":"https://github.com/schrum2/MM-NEAT/issues/25","id":255153730,"number":25,"title":"Apply RL4J to VizDoom","user":{"login":"schrum2","id":8397236,"avatar_url":"https://avatars0.githubusercontent.com/u/8397236?v=4","gravatar_id":"","url":"https://api.github.com/users/schrum2","html_url":"https://github.com/schrum2","followers_url":"https://api.github.com/users/schrum2/followers","following_url":"https://api.github.com/users/schrum2/following{/other_user}","gists_url":"https://api.github.com/users/schrum2/gists{/gist_id}","starred_url":"https://api.github.com/users/schrum2/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/schrum2/subscriptions","organizations_url":"https://api.github.com/users/schrum2/orgs","repos_url":"https://api.github.com/users/schrum2/repos","events_url":"https://api.github.com/users/schrum2/events{/privacy}","received_events_url":"https://api.github.com/users/schrum2/received_events","type":"User","site_admin":false},"labels":[{"id":683628031,"url":"https://api.github.com/repos/schrum2/MM-NEAT/labels/Convolution","name":"Convolution","color":"d4c5f9","default":false},{"id":683679227,"url":"https://api.github.com/repos/schrum2/MM-NEAT/labels/Deep%20Learning","name":"Deep Learning","color":"d93f0b","default":false}],"state":"open","locked":false,"assignee":{"login":"schrum2","id":8397236,"avatar_url":"https://avatars0.githubusercontent.com/u/8397236?v=4","gravatar_id":"","url":"https://api.github.com/users/schrum2","html_url":"https://github.com/schrum2","followers_url":"https://api.github.com/users/schrum2/followers","following_url":"https://api.github.com/users/schrum2/following{/other_user}","gists_url":"https://api.github.com/users/schrum2/gists{/gist_id}","starred_url":"https://api.github.com/users/schrum2/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/schrum2/subscriptions","organizations_url":"https://api.github.com/users/schrum2/orgs","repos_url":"https://api.github.com/users/schrum2/repos","events_url":"https://api.github.com/users/schrum2/events{/privacy}","received_events_url":"https://api.github.com/users/schrum2/received_events","type":"User","site_admin":false},"assignees":[{"login":"schrum2","id":8397236,"avatar_url":"https://avatars0.githubusercontent.com/u/8397236?v=4","gravatar_id":"","url":"https://api.github.com/users/schrum2","html_url":"https://github.com/schrum2","followers_url":"https://api.github.com/users/schrum2/followers","following_url":"https://api.github.com/users/schrum2/following{/other_user}","gists_url":"https://api.github.com/users/schrum2/gists{/gist_id}","starred_url":"https://api.github.com/users/schrum2/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/schrum2/subscriptions","organizations_url":"https://api.github.com/users/schrum2/orgs","repos_url":"https://api.github.com/users/schrum2/repos","events_url":"https://api.github.com/users/schrum2/events{/privacy}","received_events_url":"https://api.github.com/users/schrum2/received_events","type":"User","site_admin":false},{"login":"DevonFulcher","id":24593113,"avatar_url":"https://avatars0.githubusercontent.com/u/24593113?v=4","gravatar_id":"","url":"https://api.github.com/users/DevonFulcher","html_url":"https://github.com/DevonFulcher","followers_url":"https://api.github.com/users/DevonFulcher/followers","following_url":"https://api.github.com/users/DevonFulcher/following{/other_user}","gists_url":"https://api.github.com/users/DevonFulcher/gists{/gist_id}","starred_url":"https://api.github.com/users/DevonFulcher/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/DevonFulcher/subscriptions","organizations_url":"https://api.github.com/users/DevonFulcher/orgs","repos_url":"https://api.github.com/users/DevonFulcher/repos","events_url":"https://api.github.com/users/DevonFulcher/events{/privacy}","received_events_url":"https://api.github.com/users/DevonFulcher/received_events","type":"User","site_admin":false}],"milestone":null,"comments":5,"created_at":"2017-09-05T03:54:48Z","updated_at":"2018-05-24T14:01:00Z","closed_at":null,"author_association":"OWNER","body":"Use the RL4J code on VizDoom. This supposedly already works, so I can look at the RL4J code to get more inspiration, but I will use my existing code that actually successfully runs VizDoom."},"comment":{"url":"https://api.github.com/repos/schrum2/MM-NEAT/issues/comments/391725807","html_url":"https://github.com/schrum2/MM-NEAT/issues/25#issuecomment-391725807","issue_url":"https://api.github.com/repos/schrum2/MM-NEAT/issues/25","id":391725807,"user":{"login":"schrum2","id":8397236,"avatar_url":"https://avatars0.githubusercontent.com/u/8397236?v=4","gravatar_id":"","url":"https://api.github.com/users/schrum2","html_url":"https://github.com/schrum2","followers_url":"https://api.github.com/users/schrum2/followers","following_url":"https://api.github.com/users/schrum2/following{/other_user}","gists_url":"https://api.github.com/users/schrum2/gists{/gist_id}","starred_url":"https://api.github.com/users/schrum2/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/schrum2/subscriptions","organizations_url":"https://api.github.com/users/schrum2/orgs","repos_url":"https://api.github.com/users/schrum2/repos","events_url":"https://api.github.com/users/schrum2/events{/privacy}","received_events_url":"https://api.github.com/users/schrum2/received_events","type":"User","site_admin":false},"created_at":"2018-05-24T14:01:00Z","updated_at":"2018-05-24T14:01:00Z","author_association":"OWNER","body":"I ran org.deeplearning4j.examples.rl4j.Doom overnight and ended up with the same bug. Here is the stack trace and error message:\r\n\r\n21:06:44.580 [main] ERROR org.deeplearning4j.rl4j.learning.sync.SyncLearning - Training failed.\r\njava.lang.NullPointerException: null\r\n\tat org.deeplearning4j.rl4j.learning.sync.Transition.dup(Transition.java:50)\r\n\tat org.deeplearning4j.rl4j.learning.sync.Transition.dup(Transition.java:38)\r\n\tat org.deeplearning4j.rl4j.learning.sync.ExpReplay.getBatch(ExpReplay.java:45)\r\n\tat org.deeplearning4j.rl4j.learning.sync.ExpReplay.getBatch(ExpReplay.java:52)\r\n\tat org.deeplearning4j.rl4j.learning.sync.qlearning.discrete.QLearningDiscrete.trainStep(QLearningDiscrete.java:159)\r\n\tat org.deeplearning4j.rl4j.learning.sync.qlearning.QLearning.trainEpoch(QLearning.java:91)\r\n\tat org.deeplearning4j.rl4j.learning.sync.SyncLearning.train(SyncLearning.java:38)\r\n\tat org.deeplearning4j.examples.rl4j.Doom.doomLearn(Doom.java:101)\r\n\tat org.deeplearning4j.examples.rl4j.Doom.main(Doom.java:79)\r\njava.lang.NullPointerException\r\n\tat org.deeplearning4j.rl4j.learning.sync.Transition.dup(Transition.java:50)\r\n\tat org.deeplearning4j.rl4j.learning.sync.Transition.dup(Transition.java:38)\r\n\tat org.deeplearning4j.rl4j.learning.sync.ExpReplay.getBatch(ExpReplay.java:45)\r\n\tat org.deeplearning4j.rl4j.learning.sync.ExpReplay.getBatch(ExpReplay.java:52)\r\n\tat org.deeplearning4j.rl4j.learning.sync.qlearning.discrete.QLearningDiscrete.trainStep(QLearningDiscrete.java:159)\r\n\tat org.deeplearning4j.rl4j.learning.sync.qlearning.QLearning.trainEpoch(QLearning.java:91)\r\n\tat org.deeplearning4j.rl4j.learning.sync.SyncLearning.train(SyncLearning.java:38)\r\n\tat org.deeplearning4j.examples.rl4j.Doom.doomLearn(Doom.java:101)\r\n\tat org.deeplearning4j.examples.rl4j.Doom.main(Doom.java:79)\r\n size:  1029\r\n[libx264 @ 000000006b8b8aa0] consecutive B-frames:  5.9%  6.3% 12.2% 75.7%\r\n[libx264 @ 000000006b8b8aa0] mb I  I16..4:  1.8% 76.3% 21.9%\r\n[libx264 @ 000000006b8b8aa0] mb P  I16..4:  0.9%  6.8%  1.0%  P16..4: 45.2%  4.9%  2.2%  0.0%  0.0%    skip:39.0%\r\n[libx264 @ 000000006b8b8aa0] mb B  I16..4:  0.1%  0.1%  0.0%  B16..8: 36.4%  0.9%  0.1%  direct: 0.2%  skip:62.3%  L0:49.5% L1:50.3% BI: 0.2%\r\n[libx264 @ 000000006b8b8aa0] 8x8 transform intra:77.2% inter:85.2%\r\n[libx264 @ 000000006b8b8aa0] coded y,uvDC,uvAC intra: 63.3% 47.0% 21.0% inter: 5.7% 3.0% 0.2%\r\n[libx264 @ 000000006b8b8aa0] i16 v,h,dc,p: 53% 18% 15% 13%\r\n[libx264 @ 000000006b8b8aa0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18% 11% 25%  7%  8%  8% 10%  6%  7%\r\n[libx264 @ 000000006b8b8aa0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 31% 22% 20%  5%  6%  4%  6%  3%  3%\r\n[libx264 @ 000000006b8b8aa0] i8c dc,h,v,p: 68% 13% 18%  2%\r\n[libx264 @ 000000006b8b8aa0] Weighted P-Frames: Y:2.9% UV:2.9%\r\n[libx264 @ 000000006b8b8aa0] ref P L0: 64.2% 18.6% 11.9%  5.1%  0.1%\r\n[libx264 @ 000000006b8b8aa0] ref B L0: 90.7%  7.7%  1.7%\r\n[libx264 @ 000000006b8b8aa0] ref B L1: 96.2%  3.8%\r\n[libx264 @ 000000006b8b8aa0] kb/s:551.74\r\n[libx264 @ 000000005c716960] -qscale is ignored, -crf is recommended.\r\n[libx264 @ 000000005c716960] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2\r\n[libx264 @ 000000005c716960] profile High, level 3.1\r\n[libx264 @ 000000005c716960] 264 - core 148 - H.264/MPEG-4 AVC codec - Copyleft 2003-2016 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=30.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00\r\nOutput #0, mp4, to 'C:\\Users\\schrum2\\rl4j-data\\1/video/video-807-70345.mp4':\r\n  Metadata:\r\n    encoder         : Lavf57.56.100\r\n    Stream #0:0: Video: h264 (Constrained Baseline) ([33][0][0][0] / 0x0021), yuv420p, 800x600, q=2-31, 400 kb/s, 15360 tbn\r\n[libx264 @ 000000005c716960] frame I:2     Avg QP:27.81  size: 25424\r\n[libx264 @ 000000005c716960] frame P:155   Avg QP:31.96  size:  3855\r\n[libx264 @ 000000005c716960] frame B:240   Avg QP:34.94  size:  1100\r\n[libx264 @ 000000005c716960] consecutive B-frames: 13.9% 10.6% 18.1% 57.4%\r\n[libx264 @ 000000005c716960] mb I  I16..4:  3.3% 77.1% 19.6%\r\n[libx264 @ 000000005c716960] mb P  I16..4:  0.7%  4.4%  0.6%  P16..4: 45.9%  3.9%  1.9%  0.0%  0.0%    skip:42.6%\r\n[libx264 @ 000000005c716960] mb B  I16..4:  0.1%  0.2%  0.0%  B16..8: 36.2%  0.9%  0.1%  direct: 0.2%  skip:62.4%  L0:52.2% L1:47.7% BI: 0.2%\r\n[libx264 @ 000000005c716960] 8x8 transform intra:75.6% inter:86.9%\r\n[libx264 @ 000000005c716960] coded y,uvDC,uvAC intra: 61.6% 47.3% 20.7% inter: 6.1% 3.4% 0.3%\r\n[libx264 @ 000000005c716960] i16 v,h,dc,p: 49% 23% 15% 13%\r\n[libx264 @ 000000005c716960] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18% 12% 26%  7%  8%  7%  9%  6%  7%\r\n[libx264 @ 000000005c716960] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 32% 23% 20%  5%  5%  4%  5%  3%  3%\r\n[libx264 @ 000000005c716960] i8c dc,h,v,p: 68% 12% 18%  2%\r\n[libx264 @ 000000005c716960] Weighted P-Frames: Y:4.5% UV:3.9%\r\n[libx264 @ 000000005c716960] ref P L0: 66.2% 18.9% 10.1%  4.6%  0.2%\r\n[libx264 @ 000000005c716960] ref B L0: 90.7%  8.0%  1.3%\r\n[libx264 @ 000000005c716960] ref B L1: 97.7%  2.3%\r\n[libx264 @ 000000005c716960] kb/s:551.59\r\n"}}
{"actor":{"display_login":"schrum2"}}