9                 30

  : Comparison of maximal mean rewards achieved by agents. Maximal mean reward is calculated in a window of $100$ consecutive episodes. Bold denotes the highest value in each row.[]{data-label="tab:my_label"}

                       Ensemble Voting    UCB-Exploration          A3C+
  ------------------- ----------------- ------------------- ------------------
         Alien             2282.8         [**2817.6**]{}         1848.33
        Amidar             683.72              663.8          [**964.77**]{}
        Assault            3213.58        [**3702.76**]{}        2607.28
        Asterix        [**8740.0** ]{}        8732.0             7262.77
       Asteroids           1149.3             1007.8         [**2257.92**]{}
       Atlantis           1786305.0      [**2016145.0**]{}      1733528.71
      Bank Heist            869.4              906.9          [**991.96**]{}
      Battle Zone      [**27430.0**]{}        26770.0            7428.99
      Beam Rider           7991.9         [**9188.26**]{}        5992.08
        Bowling             32.92              38.06          [**68.72**]{}
        Boxing              94.47          [**98.08**]{}          13.82
       Breakout        [**426.78**]{}         411.31              323.21
       Centipede           6153.28        [**6237.18**]{}        5338.24
    Chopper Command        3544.0             3677.0         [**5388.22**]{}
     Crazy Climber        126677.0       [**127754.0**]{}       104083.51
     Demon Attack          30004.4        [**59861.9**]{}        19589.95
      Double Dunk          -11.94          [**-4.08**]{}          -8.88
        Enduro             1999.88        [**2752.55**]{}         749.11
     Fishing Derby      [**30.02**]{}          29.71              29.46
        Freeway             33.92          [**33.96**]{}          27.33
       Frostbite           1196.0         [**1903.0**]{}          506.61
        Gopher             10993.2        [**12910.8**]{}        5948.40
       Gravitar         [**371.5**]{}          318.0              246.02
      Ice Hockey        [**-1.73**]{}          -4.71              -7.05
       Jamesbond            602.0              710.0         [**1024.16**]{}
       Kangaroo            8174.0         [**14196.0**]{}        5475.73
         Krull             8669.17        [**9171.61**]{}        7587.58
    Kung Fu Master         30988.0       [**31291.0** ]{}        26593.67
   Montezuma Revenge         1.0                4.0           [**142.50**]{}
       Ms Pacman           3039.7         [**3425.4**]{}         2380.58
    Name This Game         9255.1         [**9570.5**]{}         6427.51
        Pitfall             -3.37          [**-1.47**]{}         -155.97
         Pong           [**21.0**]{}           20.95              17.33
      Private Eye      [**1845.28**]{}        1252.01             100.0
         Qbert             12036.5           14198.25        [**15804.72**]{}
       Riverraid           12785.8        [**15622.2**]{}        